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Abstract 

A theory is developed which uses "networks" (directed acychc 
graphs with some extra structure) as a formahsm for expressions in 
multihnear algebra. It is shown that this formalism is valid for arbi- 
trary PROPs (short for 'PROducts and Permutations category'), and 
conversely that the PROP axioms are implicit in the concept of eval- 
uating a network. Ordinary terms and operads constitute the special 
case that the graph underlying the network is a rooted tree. 

Furthermore a rewriting theory for networks is developed. In- 
cluded in this is a subexpression concept for which is given both alge- 
braic and effective graph-theoretical characterisations, a construction 
of reduction maps from rewriting systems, and an analysis of the ob- 
structions to confluence that can occur. Several Diamond Lemmas for 
this rewriting theory are given. 

In addition there is much supporting material on various related 
subjects. In particular there is a toolbox for the construction of custom 
orders on the free PROP, so that an order can be tailored to suit a 
specific rewriting system. Other subjects treated are the abstract 
index notation in a general PROP context and the use of feedbacks 
(sometimes called "traces") in PROPs. 

1 Introduction 



The 'algebra generated by [certain elements] which satisfy [some relations]' 
is a staple concept in mathematics and perhaps the key concept in universal 
algebra. Like most fruitful notions in mathematics, it can be defined from 
a wide variety of perspectives, including the classically algebraic (quotient 
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ring by ideal), the abstract categorical (free object in suitable category), the 
universal algebraic (quotient, set of terms by congruence relation), and the 
rewriting (terms transformed according to rules) perspectives. This text will 
mainly focus on the latter two, but the reader who so wishes should have no 
problem to view the results from any of these perspectives. 

An idea that is common to the universal algebraic and rewriting perspec- 
tives is that of the term, or (less technically) the "general expression" , which 
is viewed and studied as a mathematical object in its own right. Most for- 
malisations of this concept equips it with an underlying tree structure, where 
the results from subexpressions become arguments to the function in the root 
node for the expression as a whole; for example in ^ f {^g{x),2, h{x,y)y the 
subexpressions ^g{x)\ '2', and ^h{x,y)^ serve as arguments of the function 
/ which constitutes the root node of the expression tree. Syntactic tree 
structures, with context-free languages and BNF grammars as their perhaps 
most iconic exponents, are so prevalent within computer science that it is 
hard to imagine how things could be otherwise. And yet, there are algebraic 
structures for which trees simply are not general enough! 

Examples of such structures have begun to accumulate over the last couple 
of decades — two that should definitely be mentioned are quantum logical 
circuits and Hopf algebras — but in order to see what it is about them that 
cannot be captured in terms of tree-like expressions, one really has to sit 
down and work through the gory details of some examples. In many cases 
the crux of the matter that makes tree-like expressions insufficient is that 
the tensor product U ^ V of two vector spaces U and V is not the same 
thing as the cartesian product U x To illustrate the differences, one may 
consider creating pairs of vectors in the standard basis {61,62,63,64} of M.'^. 
A cartesian way of pairing two vectors would be to put them as separate 
columns of a matrix, whereas the tensor way of pairing two column vectors u 
and V would be to form the matrix- valued product uv""" — hence the pairings 
of 61 and 62 come out as 



61 X 62 = [61,62] 



/I 0\ 

1 



\0 0/ 



and 61 (g) 62 = 6162 



/O 1 0\ 





\o oy 



^ This may seem as a trivial observation — they are two different products of vector 
spaces, so of course they ought to be different — but the catch is that when they serve as 
the domain of a multihnear map they are not so different: hom(J7 V, W) is pretty much 
by definition isomorphic to hom(?7 x Hence when elements are paired only as a 

preparation for feeding them into a function, it need not be clear which concept of pairing 
that is the most natural. 
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respectively. These two modes of pairing behave very differently with respect 
to superposition. In the cartesian case 



[61,62] + [63,64] 

/I 0\ 

1 



\0 0/ 



+ 



fo 0\ 



1 
\0 1/ 



/I 0\ 

1 

1 

Vo ly 



/I 0\ 





vo 1/ 



+ 



/o 0\ 

1 

1 

vo 0/ 



= [61,64] + [63,62], 



so there is no way of knowing from the superposition whether it was 61 or 63 
that was paired with 62. However, in the tensor case 



6162 + 636J 






vo oy 



+ 



/o 1 0\ /O 0\ /O 1 0\ 
0000 _ 0000 
1 ~ 1 

vo 0/ Vo oy 

/o i\ /o 1\ /O 0\ 
0000_0000 0000 
0100 ~ 0000 ^ 0100 

vo oy Vo oy Vo o o oy 



7^ 



T Ti 

6164 + 6362 ! 



On the other hand, it is in a cartesian product possible to attach separate 
amplitudes r and s to the components of a pair — 



[r6i,S62] 



-but not so in a tensor product, as 



/ J, 


0] 











s 







r 














Vo 


V 






0/ 



[S6i,r62] 



(r6i)(s62)'^ 



/O rs 0\ 





VO oy 



(S6i)(r62)' 



It is not always the case that one can take a superposition of tensor prod- 
ucts apart — just like it can happen that one cannot tell from a product of 
two elements in a noncommutative ring whether that product was ah or ha 
when a and h happen to commute — but many interesting structures exploit 
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Figure 1: A whole need not reduce to two halves 



the possibility of this and other phenomena that are not seen in cartesian 
products. 

Wrapping one's head around what this implies for the syntax of expres- 
sions can however be mind-boggling at first. Sticking with the expression tree 
terminology, where it is the "children" of a function node that provide input 
to it, whereas output is passed on to the "parent", it is clear that in order 
for the expression to not simply become a tree, there must be nodes with 
more than one parent — say for simplicity that there is one type of function 
node which has two parents: one shghtly to the left and the other slightly 
to the right. This means the function produces two results, one of which 
(the left) is sent to one parent, and the other of which (the right) is sent to 
the other. The tree-minded response to this is often "Well, then split that 
function into two: one part which produces the left result and another which 
produces the right; then you can put the expression on tree form." The 
catch is, that this only works if the pair of results is viewed as living in the 
cartesian product of the ranges for the left and right respectively results; an 
element of a cartesian product is uniquely determined by what its first and 
second parts are, and this is the property that characterises cartesian prod- 
ucts. Tensor products, as demonstrated above, permit values that constitute 
an entanglement of the left and right parts; much information lies in how 
values in one part corresponds to values in the other. Therefore both parts 
have to be created as a unit, even though there is then no need to use them 
as a unit; an entanglement will simply be passed on to the next generation 
of results. (Yes, it seems odd, but it actually works that way.) 
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When venturing to explore unfamiliar mathematical phenomena, it can 
be a great help to employ a notation system that is equipped to deal with 
the oddities that lie ahead; the right notation system for the task may even 
serve as one's guide, in that it makes it easy to take the steps that are 
relevant for one's goals, as those are all steps that come naturally in the 
good notations. Conjuring up a notation system is however not a trivial 
task, as minor notational innovations can have major technical implications 
and an unfortunate choice can seriously restrict the applicability of one's 
labours. Therefore the first part of this text is spent on formally developing 
not just one, but two notation systems (although they are closely related) for 
the kind of expressions that go beyond mere trees. It is only when a concept 
of expression has been fixed that rewriting can start in earnest. 

1.1 Structure of this text 

The contents of this text partition roughly into three themes. The first theme, 
which is the subject of Sections [H HJ and is to establish the concept of 
PROP and various expression notations for it. The second theme, which is 
the subject of Sections [TJ [H and[10l is a theory of rewriting in PROPs. The 
third theme, which by elimination is the subject of Sections |3l[6l and[9l is the 
construction of custom orders on PROPs, to the end of providing consistent 
methods for orienting one's rewrite rules. Originally there was also going to 
be the fourth theme of applying the other three to establish a confluent and 
terminating set of rewrite rules for the Hopf PROP (i.e., the PROP encoding 
the operations and axioms of a Hopf algebra), but the foundation consisting 
of the first three turned out to be so voluminous that this latter theme was 
better split off; remnants of it do however show up in examples and the like. 

Within the first theme. Section [2] introduces the concept of PROP us- 
ing traditional mathematical notation and gives a variety of examples of the 
same. Section H] sets up the alternative Abstract Index Notation, which is 
a derivative of the Einstein notation (also known as the Einstein summa- 
tion convention) for tensors, and proves that it is well-defined for arbitrary 
PROPs. Section O sets up graphical networks as a third notation for PROP 
expressions, and proves that it is canonical in the sense that (i) a mathemat- 
ical structure supports this notation if and only if it is a PROP, and (ii) the 
equality modulo PROP axioms of two network notation expressions is strictly 
a matter of network (essentially graph) isomorphism. 

The degree of novelty of the material within this first theme varies from 
item to item, and is also a matter very much in the eye of the beholder. 
The examples in Section |2l save perhaps that of the biaffine PROP, should 
all be standard (even though I suspect they may be unusually concrete and 



5 



elementary for examples in this area of mathematics), but when it comes 
to Sections S] and O the results are rather within the gray area of things 
that everyone sufficiently versed in the field quickly realises are true, but 
which it is less clear whether anyone has actually taken the time to write 
out in detail before. The abstract index notation — the idea that Einstein's 
summation convention has a coordinate-free interpretation — is definitely not 
new, but formalisations of it tend to rely on trace maps (also known as feed- 
backs; see Section [9]), which reduces the range of their formal applicability to 
PROPs with feedbacks. Similarly the network notation has many precedents, 
which on closer examination may turn out to be something which formally 
is slightly different. Several authors have employed "shorthand diagrams" 
(e.g. [TU]) that more or less conform to the network notation used here, but 
perhaps rather meant that the actual proof is what one gets by transcribing 
these diagrams into more traditional notation, than claiming that already 
the diagrams as such constitute a rigorous proof. Some authors [121 [IS] treat 
the diagrams as rigorous mathematical expressions, but require feedbacks for 
their interpretations of them. Finally it may be argued that the networks 
are merely a concrete realisation of the free PROP, and a free object may 
more or less by definition be used to encode arbitrary expressions within the 
category in which it is free. It should however be observed that the net- 
works used here are discrete mathematical objects immediately encodable 
in a computer, whereas traditionally realisations of the free PROP (e.g. [7]) 
rather tend to be topological and rely heavily on properties of continuous 
space. While that may be advantageous for visualisation and can at times 
help to prove specific results, it seems highly undesirable for a piece of formal 
mathematical notation. 

The formal construction of the free PROP is here the subject of Section [SI 
this includes not only the construction as such, but also results establishing 
various additional structures within the free PROP — structures which the 
rewriting formalism makes heavy use of. In particular it defines the operation 
of symmetric join N of elements of the free PROP; despite operating in a 
setting which is more general than associative polynomials, this operation 
manages to unify things in a manner which is reminiscent of what one sees 
in the theory for commutative polynomials! 

The origin for the additional structures defined in Section |8] is the subex- 
pression concept established in Section [3 It is based on abstract index 
notation rather than the traditional notation, and it is more powerful than 
the "convex" (cf. Definition I5.14p subexpression concept that one might get 
from the traditional notation in that it can make do with infinitely fewer 
rewrite rules (it may take infinitely many rules with convex left hand sides to 
express what one rule with nonconvex left hand side can do). The fact that 
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the chosen subexpression concept has both algebraic and graph-theoretical 
characterisations makes it practical both for theory and computer implemen- 
tation [6]. 

Section [10] is where the actual rewriting formalism is set up. This is an 
application of the multi-sorted generic framework of [5] , but rather than fol- 
lowing the obvious approach of having one sort per PROP component, this 
set-up takes the more refined approach of having a separate sort for each 
transference type. This allows for rules that replace nonconvex subexpres- 
sions, and may for derived rules more accurately capture the requirements of 
their derivations. Several Diamond Lemmas for 7?.-linear PROPs (and oper- 
ads) are given, in particular Theorem 110. 24l that is directly applicable for the 
"missing fourth theme" of describing the Hopf PROP, since it comes with 
detailed account of what ambiguities need to be explicitly resolved. 

Still, it must be stated up front that the rewriting formalism of Section ITO] 
may still be a bit too coarse to really support a fully general Diamond Lemma 
for 7^-linear PROPs; rather than being the finished product, it should be 
taken as a first working prototype. Limitations are encountered in the anal- 
ysis of minimal sets of ambiguities ("critical pairs"), in that it is sometimes 
not possible to simplify an ambiguity by peeling away parts of it which are 
not in the left hand side of either rule. Even though conditions can be given 
(namely, that the rules are sharp) under which all ambiguities formed by 
a pair of rules can be simplified to one from a small finite set that can be 
constructed through a straightforward combinatorial search, not all rewriting 
systems of interest satisfy this condition. The detailed analysis given of how 
things can go wrong suggests that there really are new phenomena that arise 
in the PROP setting, and that the classical classification of ambiguities as 
being either inclusions or overlaps may have to be extended with a new class 
that are neither. 

In the third theme, we may again encounter the gray area of things pos- 
sibly known but probably not written down; the construction of strict orders 
on PROPs turns out to be surprisingly difficult once one goes beyond the 
basic 'compare counts of vertices of each type' and seeks to find something 
that takes into account the structure of the expression. Section [3] sets up 
some basic theory and provides the connectivity PROP (Example 13. 3p as 
one fundamental example, whereas Section [6] focuses on orders obtained by 
comparing matrices. With the notable exception of the connectivity PROP, 
pretty much every order I have made use of has turned out to be a special 
case of the standard order on some biaffine PROP (see Corollary 16. Sp . which 
can be both a blessing (it is very versatile) and a curse (if this seems reluctant 
to give direction to a rewrite rule, then we're pretty much out of options). 
Research to the end of constructing further examples of strict PROP orders 
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would be greatly appreciated. 

Section M is rather about providing tools to demonstrate that specific 
orders on PROPs are compatible with the rewriting framework. To that end, 
it is convenient to introduce the concept of (formal) feedbacks on PROPs, 
since these are on one hand related to the symmetric join operation, and can 
on the other hand be shown to preserve strict inequalities under the known 
strict PROP orders. 

1.2 Preview of results on 1-Lopf 

The next couple of pages make up a sort of preview of the main results 
of Network Rewriting II, the missing "fourth theme" of the present text. 
It is included primarily as a motivation for the foundational material that 
follows, to offer some problem which really exercises the various parts of the 
machinery that is being built, for the reader to better comprehend why there 
is a point in doing these things. Many parts of this text can of course be 
appreciated as interesting pieces of mathematics in their own right, but what 
motivates collecting these particular pieces together is that they combine into 
a machinery for doing rewriting, and for appreciating that it may be of useful 
to actually have a problem to which that machinery may be applied. 

For any Hopf algebra H over a field /C, the five basic operations (and 
co-operations) are — for some pair {m,n) of natural numbers — elements in 
the set hom^(H^",H®"') of /C-linear maps from 7{®" to n^"". Namely: 

Symbol Signature Name (m, n) 

/i "H ® "H — i- "H multiphcation (1, 2) 



V 


K - 




unit 


(1,0) 


A 


n — 




coproduct 


(2,1) 


e 


n - 




counit 


(0,1) 


S 


n - 




ant ip ode 


(1,1) 



The entire family {homx;('H^",'H®")}^„gj^ of maps make up an algebraic 
structure known as a PROP (with composition of maps, tensor product of 
maps, and permutation of factors as operations), and the five given elements 
generate a sub-PROP thereof, here denoted 'Hopf{'H). It may be observed 
that all Hopf algebra axioms can be stated as identities in homx;('H'^"', "H®™) 
for suitable m and n, for example the antipode axioms are that /io (S'®id) o 
A = o e = /i o (id (g) S") o A in hom^('H, "H), and this makes it possible to 
find all consequences of these axioms. 

As is generally the case in universal algebra, there is a free /C-linear PROP 
/C{f2} of which every 'Hopf{l-i) is a homomorphic image (the particular signa- 
ture VL consists of the symbols /x, ?7, A, e, 5* having coarities 1, 1, 2, 0, 1 and 
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arities 2, 0, 1, 1, 1 respectively). There is for every Hopf algebra % a unique 
PROP homomorphism /-^: 1C{VL} — > l-iopfil-L) mapping the elements of VL 
onto the generators of 'Hopf{'H), and the kernel of this map defines a congru- 
ence relation C-^ on 1C{VL}. Exactly which elements this relation considers 
to be congruent depends on "H, but it is known that it at least considers the 
left hand sides of all Hopf algebra axioms congruent to their respective right 
hand sides, e.g. /i o (S* ® id) o A = 77 o e (mod C-h). Since there for every set 
of such identities is a minimal congruence which satisfies them all, there is in 
particular a congruence Cnopf on /C{f2} which is generated by only the Hopf 
axioms, and hence Cnopf ^ C-n for every Hopf algebra It follows that 
every /-^ splits over the PROP l-Lopf := /C{fi}/CHopf, so in particular every 
'Hopf{l-C) is an image of Hopf. The main aim of Network Rewriting II will 
be to describe the structure of this general Hopf PROP, and in particular 
provide an algorithm for deciding equality in Hopf . 

Technically this is done by turning the Hopf algebra axioms into rewrite 
rules, and completing the corresponding rewrite system. The suitable in- 
stance (Theorem 110. 24p of the Diamond Lemma then gives an isomorphism 
between Hopf and a vector subspace of ]C{fl}, and a projection of }C{Q} onto 
this subspace which maps elements to the same thing if and only if they are 
congruent modulo Cnopf- Since this projection is computationally effective, 
an equality algorithm is merely to apply it to the difference between the two 
elements to compare, and check whether the projection maps this difference 
to zero. 

The completed rewrite system consists of 16 infinite families of rules and 
14 isolated rules, stated here in abstract index notation (see Section H] and 
page 1161]) . The 14 isolated rules are: 




(1.1a) 
(1.1b) 
(1.1c) 
(l.ld) 
(Lie) 
(l.lf) 

(1-lg) 
(l.lh) 

(l.li) 






a 
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EaS^i > Eb, (1.1m) 

AfS:^S:S',Ai'^; (l.ln) 



the first 10 of wfiicli are tlie axioms for a bialgebra — 3 axioms for a unital 
associative algebra, 3 axioms for a counital coassociative coalgebra, and 4 
axioms stating the compatibihty of the algebra and coalgebra structures. 
The last four rules encode the facts that the antipode 5* is an algebra and 
coalgebra antihomomorphism; these are usually not taken as axioms, since 
they are implied by the "formal group inverse" axioms /x^^ 5*^ Af^ = ■)]"■ Ee = 
S2 A^^ for the antipode, which are the = instances of fll.2ap and 
dObl). 

The set (11. ip of rules constitute a complete rewrite system which, al- 
though weaker than the full set of Hopf algebra axioms, still suffice for trans- 
forming any monomial element of /C{f2} to the normal form AoB oC, where 
A is constructed from the algebra operations and ?7, C is constructed from 
the coalgebra cooperations A and e, and B is constructed from (permutations 
and) the antipode S. The remaining 16 families of rules all remove certain 
patterns that may be present in such an A o B o C composition, and the 
reason they are families is that there is no bound on the number of antipodes 
that may be present on each string in the B part; the family parameter N is 
mostly a counter for how many multiples of 5"°^ that are common to the B 
part strings in the rule: 



^.^(^o(2A.))C^^„(,^^i))J^e/^^.^^ (1.2a) 

^,l^{S<'^^X[S°i-^)))Alf^r^'E, (1.2b) 

/^L {S<'^^% Af ^ r^^E, (1.2c) 

/^L {S<'^^-))) Af ^ r^^E, (1.2d) 

Kc/^L {S°''''^% [S^^'^'X Af ^ 5^,E, (1.2e) 

^lAe Af/ ^ 5^,E, (1.2f) 

^l^\e {S<''^^% {S^^^^^X ^ ^dSH (1.2g) 

/^^./^L [S^^'^-^'X {S<'^^X Ai^ ^ 6^,E, (1.2h) 
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Ar Af 
Ar Af 



Jh 



6] 6 , 
5] 5 , 



i j 



b 

e 

b 

e 



(1.2i) 

(l-2j) 
(1.2k) 
(1.21) 

where a r\ e, (1.2m) 
where a r\ e, (l-2n) 
where a r\ e, (1.2o) 
where a r\ e. (l-2p) 



While these 16 families are distinct, it should also be clear that they are very 
much variations on a single theme, and indeed there are many ways in which 
the rules of one family logically implies the rules in another when fll.ip is 
given. What they all amount to is basically that two strings of antipodes 
cancel each other out if (i) they are adjacent both in the A and C parts of 
the expression, (ii) the number of antipodes on them differ by exactly 1, and 
(iii) they cross each other iff the string with the lower number of antipodes 
has an odd number of antipodes. 



1.3 Notation 

The set N of natural numbers is considered to include 0. The set of positive 
integers is written Z+. A semiring is like a ring, except that elements need 
not have an additive inverse; N and Z are (associative and commutative 
unital) semirings, but Z4. is not a semiring (on account of not containing a 
zero element). 

Matrices with parenthesis delimiters are ordinary matrices. Matrices with 
bracket delimiters are block matrices, where entries may themselves be ma- 
trices, and it is then the elements of those entries that are elements of the 
block matrix. As usual, the entry of a matrix A may be denoted Aij, 
ttij, Ai^j, or ai,j depending on which is most clear in context. Note, however, 
that e.g. Aij might often denote some block in the matrix A; in such cases 
it is explicitly defined as such. Jmxn denotes the m x n matrix of ones, i.e., 
the m X n matrix where all elements are 1. 

Brackets are also used in the notation [a]~ for the equivalence class of 
a (with respect to some equivalence relation ~), and in the notation [n] for 
{1, . . . , n}; on the latter, see Definition 12. 3[ 
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Composition of maps has the inner function on the right, so (/ o g){x) — 
f(^g{x)Y In some places. {f,g){x) is used as a shorthand for (/(x), g'(x)). 
Given a function / : A — > B, the corresponding direct and inverse set maps 
are defined by 

p(/)(X)= {f{x)\xeX} iorXCA, 
{xeA\f{x)eY} iorYCB; 

the p() notation is because making p{f) and p{f) out of / is precisely what 
the CO- and contravariant respectively power set functors do with morphisms. 
For p{f){A), the shorter notation im/ is frequently used. The restriction of 
/ to X C A is denoted f\x- The identity function/map is generally denoted 
id. 

2 PROPS 

PROP is short for 'PROducts and Permutations category', a special case of 
symmetric monoidal category, but this etymological background is of little 
relevance for their use here. Rather, PROPs will be viewed as just another 
type of abstract algebraic structure, and incidentally one for which matrix 
arithmetic provides several elementary examples. An instructive PROP is 
that which consists of all matrices regardless of sides over any fixed (unital 
associative semi-)ring, since the syntactic restrictions on the composition 
operation in a PROP are the same as for matrix multiplication. 

Concretely, a PROP V is usually defined as a family {"^(^i 
of sets (the components of the PROP, which in the categorical formalism 
are precisely the hom-sets) together with some operations satisfying certain 
axioms. In the PROP TZ*^* of all matrices over some ring TZ, the family of 
components is thus {'^'"^"}„j nefi' every number of rows m and every 

number of columns n there is the component TZ^^^ oi m x n matrices over 
TZ. In the abstract setting, the indices m and n are called the coarity and 
arity respectively, and P(m, n) is simply the set of elements in V which have 
arity n and coarity m. 

The first operation 'o' is called composition. It is similar to matrix multi- 
plication in that it is a map V{1, m) x P(m, n) — > V{1, n) for any l,m,n G N, 
and in the PROP TZ*^* it really is matrix multiplication. Like matrix mul- 
tiplication it is associative and has identities — a separate identity in every 
V{n, n). 

The second operation (g) is called the tensor product (although in the 
case of TZ*^* this is perhaps not the first name one would choose for this 
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operation), and has signature V{k, I) (g) V{m, n) — y V{k + m,l + n) for all 
k, 1,171,12 G N. Intuitively it is often a way of putting the left factor beside the 
right factor without making them interact, and in the 7^*^* PROP it merely 
amounts to putting the two factors as diagonal blocks in an otherwise 
matrix, e.g. 

ai2 \ 
022 
bn bi2 

&21 &22 / 

(There are other matrix PROPs in which (8> really ends up multiplying matrix 
elements, e.g. when it is the Kronecker matrix product, but we'll get to that 
later.) The tensor product is associative and has a unique identity element 
(with arity and coarity 0). 

The final operations are the actions of permutations on PROP elements, 
which in the case of TZ'^* are permutation of rows (in the case of left action) 
and permutation of the columns (in the case of the right action). Alterna- 
tively (and with slightly less machinery) this can be formalised as a family 
{0„}nGN of maps from the permutation group S„ on n elements to V{n,n), 
such that the actions are given by aa = (pmicr) o a and ar = ao (j)n{T) for all 
a e V{m,n), a e S^, and r G S„. In 71*^', the matrix 0m(o") is thus the 
permutation matrix corresponding to a, with 4>m{o')i,j = 1 iff i = o"(j). 

Besides these, many PROPs come with a linear structure such that each 
V{m,n) is a module over some ring — 7^"ix" jg for example an 7^-module — 
but this is not part of the basic concept. As is common in diamond lemma/ 
Grobner basis/rewriting theory, there will be a need both for a structure 
of "monomials" and for a structure of "polynomials" , and in this case both 
of these will be PROPs, just like both the monomials and polynomials of 
commutative Grobner basis theory constitute monoids. The structure that 
relates to a basic PROP as an 7^-algebra does to a monoid is the TZ-linear 
PROP, and one can always construct an 7^-linear PROP from formal 7^-linear 
combinations of elements from another PROP; Construction 12.131 gives the 
details. 

2.1 Formal definition and basic examples 

Definition 2.1. An N^-graded set P is a set together with two functions 
a'p,uj'p: V — )■ N. In this context, the value a-p{h) is called the arity of h and 
the value uj-pip) is called the coarity of 6; the dependence on V is usually 
elided. Denote by V{m, n) the set of those elements in V which have coarity 
m and arity n. 



ail oi2 

'3'21 I3'22 



hii bi2 

&21 &22 



/an 

^21 
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Modulo some formal nonsense regarding the distinction between formally 
disjoint union and plain set-theoretic union, any family \^V{m,n)Y^^^^ of 

sets parametrised by two natural numbers may be regarded as an N^-graded 
set, so in particular any PROP may viewed this way. This simplifies the 
definition of many basic concepts such as sub-PROP, PROP morphism, and 
generating set, but concrete constructions often tend to describe each com- 
ponent separately, and it frequently happens that a strict set-theoretic inter- 
pretation of these descriptions would make some components non-disjoint; 
in such cases it is to be understood that elements from different components 
of the PROP are distinct when the PROP is viewed as an N^-graded set. 

Definition 2.2. Let V and Q be N^-graded sets. An N^-graded set mor- 
phism /: V — > Q is a map V — > Q which preserves arity and coarity, i.e., 
OiQ{f{b)) = a-p{b) and UQ[f{b)) = uj-p{b) for all b E V. More generally, a 
map /: V — > Q is said to have degree {k, I) if co'q(/(6)) = k + uj-pib) and 
aQ{f{b)) = I + ar{b) for all beV. 

As might be expected, PROP homomorphisms are N^-graded set mor- 
phisms which satisfy some additional conditions. Various kinds of deriva- 
tives are often convenient to formalise as degree (0, 1) or (1, 0) maps, but 
those concepts are more natural to discuss using the abstract index notation 
introduced in Section HI 

Permutations are an important ingredient in the PROP concept, so before 
giving the formal definition of the latter, it is necessary to introduce some 
notations for the former; some of this should be familiar, but other parts are 
uncommon outside discussions of PROPs. 

Definition 2.3. For all n G N, let [n] denote the set {!,..., n}, and in 
particular [0] = 0. Then define the permutation group S„ to be the group 
of all bijections [n] — )■ [n]. In particular, Sq is considered to be a group with 
one element. Explicit permutations may be written in relation notation, 
where o" = ( J^^^ J2) cr{n) ) > but more commonly in cycle notation, where 
[ki k2 . . . kr) denotes the permutation a which satisfies a{ki) = k2, <j{k2) = 
ks, . . . , a{kr-i) = kr, a{kr) = ki and leaves all other elements fixed. 

For the PROP axioms, it is convenient to introduce the notation ^X™ for 
the element of S^+m which exchanges a left block of k things with a right 
block of m things, i.e., 

'x-w^l'+r l'^': (2.1) 

\t — k it I > k. 

One may think of this as a crossing of two flat "cables" , one containing k 
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wires and the other containing m wires. Similarly the identity element in E„ 
will be written as I". 

The PROP axioms also use the permutation juxtaposition product {a, r) i— >■ 
(7 -kT : X E„ — > E^+„, which is defined by 

(a^r)W = <^ )> ' (2.2) 

\t[i — m) +m n I > m. 

The group product of permutations, i.e., the function composition, will be 
written as o if there is a need to emphasise this operation, but usually the 
permutations are just written next to each other. 

Definition 2.4. A PROP V is an N^-graded set together with a family 
{<Pn}neN of maps (pn- — > V{n,n) and two binary operations 'o' (com- 
position) and '(g)' (tensor product). The (g) operation is considered to have 
higher precedence (binding strength) than the o operation. For any a,b &V, 
a{a ® 6) = a{a) + a{b) and uj{a ^b) = uj{a) + uj{b). Composition is a partial 
operation, such that a o fe is defined if and only if a{a) = U!{b), in which case 
a{a ob) = a{b) and u{a ob) = oj{a). 

A PROP must furthermore satisfy the following axioms: 

composition associativity {a o b) o c = a o (6 o c) for all a e V{k,l), 
b G V{l,m), and c G V{m,n). 

composition identity ^mC'") o a — a — ao 0n(l") for all a G V{m, n). 

tensor associativity {a®b)®c — a®{b®c) for all a G V{k,l), b G 'P{m,n), 
and c G P(r, s). 

tensor identity 0o(l°) ®a = a = a® 0o(l°) for all a G V{m, n). 

composition— tensor compatibility {aob)®{cod) = (a (g) c) o (6 (g) d) for 
all a G V{1, m), b E V{m, n), c E V{k, r), and d G P(r, s). 

permutation composition 0„(o') o 0„(r) = (f)n{crT) for all a,T E E„. In 
other words, each 0„ is a group homomorphism. 

permutation juxtaposition (t)m{cr) ® ({)n{'T) — 0m+n(c*'?') for all a G E^ 
and T G E„. 

tensor permutation ^fc+^C^X"*) o (a (g) 6) = (6 (g) a) o 0i+„('X") for all a G 
V{k,l) and 6 G V{m,n). 
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Since the index of a 0„ map is clear from the permutation fed into it, this 
part of the notation is often omitted. (In practical applications, it is common 
to leave the 0„ maps out altogether.) 

A PROP (homo)morphism /: V — )■ Q is an N^-graded set morphism 
which preserves o, (g), and 0, i.e., /(a o-p h) = f{a) oq f{b), f{a ^-p h) = 
f{a) ®s and / o 0p = 0q. 

A sub-PROP Q of "P is a subset of V which contains 0„(S„) for all n 
and is closed under the composition and tensor product operations of V. An 
N^-graded set C "P is said to generate V if the only sub-PROP of V that 
contains VLisV itself. The sub-PROP generated by VL is the intersection 
of all sub-PROPs of V that contains Vt. 

A PROP V is said to be 7?.-linear for some ring TZ if every 'P(m, n) is an 
7^-module and the two operations o and ® are 7^-bilinear. A homomorphism 
f : V — )■ Q is 7?.-linear if V and Q are both 7^-linear and the restriction of 
/ to every component of V is 7?.-linear. 

Theorem 15.131 can be taken as an alternative definition of PROP, as an 
N^-graded set which supports (and is closed under) evaluation of networks. 
Although that requires a heavier machinery to set up (particularly for defin- 
ing 'network'), it is far more intuitive and not as seemingly arbitrary as Def- 
inition 12. 4[ The natural next step is however to give examples of structures 
that satisfy the set of axioms given above. 

Example 2.5 (Permutations PROP). The set of all permutations constitute 
a PROP V with the group operation(s) and -k as composition and tensor 
product respectively; 



P(m, n) 



ZI„ if m = n, 
otherwise, 



a o T := ar, a ® t := a -k t, and 0(cr) := a. Several axioms are mere 
trivialities for this PROP, and even those that may be non-obvious (e.g. the 
tensor associativity and tensor permutation axioms) are straightforward to 
verify through explicit calculation. 

If Q is another PROP then 0g is a PROP morphism V — )■ Q. Hence the 
permutations PROP is a free PROP, although for an empty generating set. 
A general construction of the free PROP is the subject of Section [HI 

The next example demonstrates that one doesn't have to keep the per- 
mutations distinct. 
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Example 2.6 (Ring PROP). Let TZ be an associative and commutative unital 
ring. Let V be the N^-graded set where 



V{m,n) — 



TZ ii m = n, 

{0} C TZ otherwise, 




let 0n(c) — 1 E TZ — T^{n, n) for all a e E„, and let o and ® onT' both be 
the multiplication in TZ. Then P is an 7^-linear PROP. 

It follows from the tensor permutation axiom that ah = loa®6 = 
02(^X^) oa®6 = 6®ao 02(^Xi) = 6 ® a o 1 = 6a for all a, 6 e P(l, 1) = 7^, 
so this example requires TZ to be commutative. 

There is however a way to turn noncommutative rings into PROPs, by 
only putting them in the (1,1) component. This is essentially the same con- 
struction as that of an operad from a ring, where only the arity 1 component 
is nontrivial. 

Example 2.7. Let TZ be an associative and commutative unital ring. Let A 
be an associative unital 7?.-algebra. Let be the N^-graded set where 

if m = n = 0, 
P(m, n) = ■{ A if m = n = 1, 
otherwise. 

Define o to be: 

• the multiplication in TZ when mapping P(0, 0) x P(0, 0) — > P(0, 0), 

• the multiplication in A when mapping P(l, 1) x P(l, 1) — > P(l, 1), 
and 

• the constant map otherwise. 
Define (g) to be: 

• the multiplication in TZ when mapping P(0, 0) x P(0, 0) — > 7^(0, 0), 

• the action of 7^ on ^ when mapping 7^(0, 0) x 7^(1, 1) — > 7^(1, 1) or 
P(l, 1) X P(0, 0) P(l, 1), and 

• the constant map otherwise. 

Finally define 0o(l°) = 1 & TZ, = 1 e A, and 0n(a) = for all a e S„ 

and n>l. Then is an 7^-linear PROP. 
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There are also constructions along the same line of PROPs from arbitrary 
(symmetric) operads where the coarity 1 components of the PROP are exactly 
the components of the operad, but these get more technical — in part because 
the axioms for an operad, though fewer, are much messier than their PROP 
counterparts. It is easier to define an operad as the coarity 1 components of 
a PROP, and introduce the structure map as 



m 



lm,...,nm ia,bi, . . . ,bm) = a o bi ® ■ ■ ■ h 
or i'th composition as 

A better first example of a PROP with nontrivial off-diagonal components 
is the PROP of matrices, which was sketched above but can do with getting 
the corner cases straightened out. 

Example 2.8 (Matrix PROP). For every associative unital semiring TZ, there 
is a PROP TZ"" such that: 

• TZ*^'{m,n) = 7^™^"- (m-by-n matrices whose entries are elements of 
TZ). In particular, each of the degenerate sets 7?.°^" and 7^™^° jg 
sidered to have exactly one element, which is denoted 0. 

• The composition o: T^'x"^ x 7^™^" — !. 7?.'^" is multiplication of an 
Z-by-m matrix with an m-hj-n matrix. In the case that m = 0, the 
result is the l-hj-n all zeroes matrix. 

• The tensor product ® constructs a block matrix from its factors, by 
putting these on the main diagonal and filling the rest of the matrix 
with zeroes: 

\A 



B 



(This is often called the direct sum of two matrices, and is then typically 
denoted ©. A PROP where is the "usual" (Kronecker) tensor product 
of matrices can be found in Example 12.101 ) 



The (pn maps map permutation to corresponding permutation matrices, 
i.e., 

1 if i = a(j), 
otherwise. 



4>n{<y)i,j 
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The PROP axioms are either well-known properties (e.g. matrix multiplica- 
tion is associative) or easily verified through direct calculations. The tensor 
permutation axiom is for example verified by observing that 



'0 




O 


'A 


0" 




'0 


B 


Ik 








B 




A 






'B 


0" 


o 


'0 


In 





A 


h 






where denotes the n x n identity matrix. 

In TZ'^', every component is an 7?.-module, and if TZ is commutative 
then composition is 7?.-bilinear, but the PROP as a whole is typically not 
7^-linear. The reason for this is that its tensor product fails to be bilinear; 
e.g. {2 A) ® (25) = 2{A^ B), whereas the left hand side would be equal to 
4{A ® 5) in a Z-linear PROP. 

However, when PROPs occur in higher algebra, it is usually first as some 
variant of the following, where the operations are bilinear by design. 



2.2 The Horn PROP and friends 

Example 2.9 (The T-Lom PROP). Let TZ be an associative and commutative 
unital ring. Let V be an 7^- module. Let 'Homv{Tn,n) be defined for all 

m, G N by 

Uomvirn, n) = hom7^(V^®", V^®"^), where V^®" = V^n-y^nV^ (2.3) 

n factors 

and hom7j(?7, W) is the space of all 7^-linear maps from U to W; this space 
is an 7^-module under pointwise operations. Let the composition and tensor 
product on 1-Lomy be the ordinary compositions and tensor products of TZ- 
linear maps, i.e., 

(a o 6)(u) = a(6(u)) for all u G F^™, (2.4) 

(a® c)(u® v) = a(u) ®c(v) for all u G 1/^' and v G 1/®", (2.5) 

for all a G Tiomvik, I), b E T-Lomvil, m), c E l-iomvijn, n), and /c, l,m,n G N. 
(It may be remarked that the argument u®v of a®c in (12. 5p is not a general 
element of \/®('+"), but since \/®('+") is spanned by vectors on this form and 
a ® c is an element of hom7^(V"®'''"'""''', V^®*^'^"'"'"^) it is nonetheless sufficient. 
The same argument applies in (12.61) .) Finally let S„ — > 'Homy{n^n) be 
defined by 

0ri(a)(ui (g) ■ ■ ■ (g) u„) = u^-i(i) (8 ■ ■ ■ ® u^-i(„) (2.6) 
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for all Ui, . . . , u„ G F and cr G S„. Then T-Lomv is an 7?.-linear PROP. 

The most reasonable method for proving that Tiomv is a PROP is prob- 
ably to fall back on the category theory from which the name 'PROP' orig- 
inated, and consider the category whose objects are {V'^"'}nm and whose 
hom-sets are those given by hom-;^; this is a small full subcategory of the 
category of 7^- modules. In that context, the associativity and identity of 
composition in the PROP are simply these properties with respect to mor- 
phisms in a category. The composition-tensor compatibility axiom must be 
satisfied because — — is a bifunctor in this category, and the tensor product 
associativity and identity axioms must be satisfied because this bifunctor is 
a product, whose neutral object is V^^ = TZ. As for the permutation axioms 
however, it might be less work to verify these through explicit calculations. 
In the case of permutation composition, this amounts to 

0„((jr)(ui (g) ■ ■ ■ (g) u„) = U(^^)-i(i) (g) ■ ■ ■ (g) U(^^)-i(„) = 

(*) 

= U^-i(^-i(i)) (g ■ ■ ■ (g U^-i(a-i(„)) = 0„(o-)(u^-i(i) (g ■ ■ • (g U^-i(„)) = 

= (pnicr) (0„(r)(ui (g • ■ ■ (g u„)) = (0„(cr) o 0„(r)) (ui (g • • ■ (g u„), 

where the step marked (*) may seem mysterious, but should after defining 
Vi = Ut— be easily recognisable as an instance of (12.61) . Proving bilinearity 
of o and (g as defined above is a standard exercise. 

Example 2.10. In the case that V = TZ^ for some integer k, V^^ is isomor- 
phic to 71^"" , and l-Lomy (m, n) may thus be viewed as a set of /c™ x A;" matrices. 
A convenient choice of isomorphism is that which, given that {ej}^]^ denotes 
the standard basis of 7?.^, maps 

n 

ed, ® ■ ■ ■ (g eo where D-l = ^{di - l)k'-^ (2.7) 

i=l 

for all di,...,dn G [k]\ effectively the numbers di — 1 are interpreted as 
"radix-fc digits" of D — ll^ Under this isomorphism, the permutations are 
again mapped to permutation matrices, but rather than permuting rows or 
columns it is the "radix-fc digits" in row or column indices that are permuted; 
0n(cr)t,j = 1 if and only if 2-1 = d^(r)k'''~^ for rfi , . . . , rf^ G {0, . . . , A;-l} 

^ This is much less cumbersome to express using zero-based indexing — numbering the 
basis vectors of TZ^ from eo to ejv_i — but violating the convention about matrix indices 
beginning at 1 would also be a source of confusion. 
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such that j 



En 
r=l 



r-1 



Hence 



for k 



/I 0\ 
10 
10 
\0 1/ 

/I 0000000 0\ 
000100000 
000000100 
010000000 
000010000 
000000010 
001000000 
000001000 

\ooooooooiy 

As usual o is matrix multiphcation, but ® is the Kronecker matrix product 
given by 



for k = 3. 



[hii ... hin\ 



A 



ml 



7 



Ahii ... Ah 



In 



Ahml 



AK. 



where the right hand side block matrix is km x In when A is A; x /. 

Example 2.11 (Quantum gate array PROP). Let V = Homv in the case 
that V = (as a complex vector space). In this case, V{m,n) may be 
viewed set of 2"^ X 2" matrices. Let 

Q={AeV\A is unitary, i.e., AA^ = I = A^A } 

where A'^ denotes the Hermitian conjugate of A. Then Q is a PROP (with 
Q{m,n) = for m 7^ n), since 0Q(cr)^ = (j)Q{a)^ = 4>Q{a-^), {AB){ABy = 
ABB^A^ = AIA^ = I, and (A ® 5)(A O 5)t = {A®B){A^ ®B^) = (AA^) ^ 
{BB^) = I ® I = I for all permutations a and A, B E Q. 

By definition, a qubit is a quantum system whose state space is C^, and 
a register of n qubits therefore has state space (C^)®". Any unitary 2" x 2" 
matrix corresponds to a quantum gate operating on a register of n qubits. 
Therefore, Q may be called the quantum gate array PROP. 

The interesting point here is not so much that the unitary matrices con- 
stitute a PROP — similar arguments can be carried out for many other well- 
known sets of matrices, and the tensor product of TZ'^* may actually be easier 
to reason about — but that the basic operations in a PROP correspond di- 
rectly to basic operations for composing quantum gate arrays. Q(n, n) is the 
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set of operations that can be applied to an n-qubit register. Composition 
is to first apply one operation and then the other. The tensor product says 
what happens when you act on some qubits of a register with one operation 
and on the remaining qubits with another; if A G Q{m,m) and B G Q{n,n) 
then B applies A to the first m qubits and B to the remaining n qubits 
of a register of m + n qubits. 

Permutations are less common in presentations of quantum circuits, but 
they are used implicitly when one lets gates act upon arbitrary lists of qubits 
rather than just those adjacent to each other. For example, if a CNOT G 
Q{2, 2) gate is to be used to let qubit 3 of a 7 qubit register control whether to 
negate qubit 6, then one might express the corresponding element of Q{7, 7) 
as 

★ 2X2) o </,(|2) <g) CNOT (8) (f>{\^) O ★ 2x2) 

or, if cycle notation for permutations is preferred, 

0((13)(2 6)) oCNOT®0(l^) o0((13)(2 6)). 

Conversely, if NOTC G Q(2, 2) is CNOT where qubit 2 controls the negation 
of qubit 1, then (t)(^X^) = CNOT o NOTC o CNOT, so general permutations 
can be realised by a quantum gate array even if the qubits are in fixed 
positions. (Whether it would be practical to do so under a specific qubit 
register implementation is of course a separate matter.) 

Another example of physics relevance is the PROP of tensor fields on a 
manifold. Given an associative and commutative unital ring TZ that consti- 
tutes the set of one's "scalar fields" , and an 7?.-module V of derivations on TZ 
that constitutes one's "vector fields" , the elements of the Honiv PROP will 
be the corresponding general "tensor fields" . 

Example 2.12 (Physicist's tensor fields). Let M be a real, smooth k- 
dimensional manifold, and let TZ be the ring of infinitely differentiable func- 
tions M — > M; elements of TZ may be called (smooth) scalar fields (where 
'field' is used in the physics sense rather than the abstract algebra sense). Let 
V be the set of all R-hnear functions X : TZ — > TZ which satisfy X{f ■ g) — 
X{f) • g + f • X{g) for all f,g eTZ. Such functions are called (smooth) vector 
fields on M; they are necessarily local in the sense that if [/ C M is open and 
f e TZ is such that f{p) = for all p e U then X{f){p) = for all p e U. 
Note the explicit function application parenthesis; in differential geometry, it 
is otherwise common that the result of applying a vector field X to a scalar 
field / is just written Xf. The "value at a point p G M" of a vector field X 
is the function TZ — > R given by / i->- X{f){p); differential geometers may 
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be more comfortable with the notation Xpf for X{f){p) (the value of X{f) 
at p). 

The set V is an 7^-module, with {fX){g) = f ■ X{g) for all f,gE7l and 
X & V. This being an 7?.-module, one can form the n-fold tensor product 
y^n Q^gj, TZ of V with itself. There is a canonical 7^-linear map 6 from V"®" 
to 7^" — > 7^, with 

n 

e{X^ ®7^ ■ ■ ■ ®7^ X„,)(/i, ...,/„) = J] X,(/,) (2.8) 

i=l 

for all Xi, . . . , X„ e and /i, ...,/„ G 7^. 

A (smooth) tensor field on M is an element of 'Homy, where 'Homy{m, n) = 
homTiiV^"^, V'^"') as in Example 12.91 Since V^'^ = TZ and an 7^-linear map 
a: IZ — )■ V®™' is uniquely determined by a(l), it follows that T-LomviO, 0) = 
71 and 'Homy(l,0) = V, as expected. ?^omy(0, 1), the set of covector 
fields, consists of maps from V to 71, and any f E TZ defines a differen- 
tial df e ?/omy(0,l) via d/(X) = X(/) for all X e V. A tensor field 
a e 'Homv{iTL,n) is symmetric if 0(cr) o a o 0(r) = a and antisymmetric if 
0(cr) o a o 0(r) = (— 1)°"(— l)'^a for all a G and r G An n-form field 
is an antisymmetric element of 'Homv{0,n). 

Since 7^ contains "bump functions" — for any open U ^ M and p & U, 
there exists some open neighbourhood U' <Z U of p and B & 7Z such that 
-B(g) = 1 for all q & U' and B{q) = Q for all g G M \ f/ — it is possible to 
realise quantities locally defined on some neighbourhood of a point p as fields 
defined on the whole of M, in such a way that these global fields at least 
coincide with the original local field on a neighbourhood of p. In particular, 
one can for every chart {U,ip) (where [/ C M is open and y?: U — )■ is 
injective) of the manifold M define a set {xjjjL^ C 7^ of coordinate functions 
valid around p eU hj 

x.(g) = l''^'^'^^^°^^^'^ (2.9) 

^' \0 forgGM\f/, ^ ' 

where i? G 7^ is some suitable bump function with B{p) = 1 supported 
within U and — )■ M denotes projection onto the ith component. A 
corresponding set {Ei}^^^ C V of standard vectors can be defined by 

W)W 4^<'' ■ (2.10) 

[O for qeM\U, 

where B is the same bump function and ^ is the partial derivative with 
respect to the i component of M^. These scalar and vector fields locally 
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constitute a basis in the sense that 

k 

Y(f)(q) = J2^ixi)(q) ■ m){q) where B(q) = 1 (2.11) 

i=l 

for arbitrary f e TZ and Y e V. This extends to recovering the old 
"multidimensional array of numbers" view of tensors, since any tensor field 
a e l-Lomv{m,n) locally determines component scalar fields via 

m n 

(X) where n, . . . , rm, si, . . . , s„ e [k] 

i=l i=l 

(2.12) 

and conversely 

k m n 

ri,...,rm,si,—,Sn=l j=l i=l 

in the sense that 

^(«((8)r=i^^))(/i.--->/j(?) = 

fe m n 

ri,...,rm,si,...,s„=l i=l i=l 

for g near p, all /i, ...,/„ e 7^, and all Fi, . . . , F„ e l^. 
2.3 More PROP examples 

The rewriting set-up works with linear PROPs, since many theories require 
a linear structure, even those that do not often benefit theoretically from 
having one available, and in those remaining cases where it really isn't of 
any use it can mostly be ignored (just like word problems in semigroups 
can be studied in associative algebras as problems regarding ideals generated 
by binomial relations). This, of course, calls for a method of equipping 
arbitrary PROPs with a linear structure. The following is a generalisation of 
the construction of a group algebra, so it is natural that one uses the same 
notation for both, albeit with a PROP in the place of the group. 

Construction 2.13. Let a PROP V and an associative commutative unital 
ring 71 be given. Let TZV be the M^-graded set for which each TZV {m,n) is 
the set of all formal 7?.-hnear combinations of elements of P(m, n). Extend 
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o and (g) to TZV by 7^-bilinearity. Then TZV is an 7?.-linear PROP, and each 
TZV{m, n) is a free 7^-module with basis 'P(m, n). If Q is an 7^-hnear PROP 
and /: V — ?■ Q is a PROP homomorphism, then / has a unique extension 
to an 7^-hnear PROP homomorphism TZV — > Q. 

Proof. The construction of formal hnear combinations of a set of elements, 
and extension to it by linearity of operations, is well known and requires 
no explanation here. What is less clear is perhaps that the axioms survive 
this extension, but this is straightforward to verify; e.g. three general el- 
ements of TZV{k,l), 7lV{l,m), and TZV{m,n) respectively have the forms 
ZliLi^i^i) Y.i=iSibi, and X]i=i ^^c^ respectively, where {0,}^^ C V{k,l), 
{bi}l, C V{l,m), {c,}t, C P(m,n), and {s,}l„ {U}g, C 7^. 

Hence it follows from 

c 




i=l j=l h=l i=l j=l h=l 

B C 



y^jhCh 

h=i ^ 

J2 ^^^^^^^ \ J2 ^^^h 

i=l j=l ' ^h=l ^ 

ABC ABC 

^ Y^Y^riSjth[[ai o hj) o Cfe) = Y^'^'ri^jthiai o (6^ o Ch)) 

i=\ j=i h=i 

A . . B C . 

5Z ^i^* ) ° ( 5Z 5Z ^j^'^^^j ° ^'^^ ) = 

i=l ^ ^.7 = 1 h=l ^ 

j=l ^ ^h=\ ^ . 

that the composition associativity axiom holds also in TZV as a whole. 

Similarly, any map V{m,n) — > Q{'m,n) extends uniquely to an TZ- 
linear map TZV{'m,n) — )■ Q{m,n) by the basis property, so the extension 
of f : V — > Q to the whole of TZV is uniquely determined already by the 
7^-linearity condition. Checking that this extension of / continues to satisfy 
the definition of a PROP homomorphism is straightforward. □ 

Thus having some examples of 7?.-linear PROPs, one may also take Ex- 
ample [231 the other way and observe that, for any 7?.-linear PROP V: 

• for each n G N, the component V{n,n) is an associative unital TZ- 
algebra with o as multiplication and 0(1"') as unit (except that unitality 
fails where V{n,n) = {0} as it would require 7^ 0(1")); 
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• for each n e N, the component V{n,n) for n e N is an associative 
unital 7^(0, 0)-algebra with o as multiphcation and as scalar multiple 
operation (except, as above, for the unitality catch should V{n, n) — 

{0}); 

• for all m, n G N, the component V{m, n) is a left V{m, m)-module, right 
V{n, n)-module, and (P(m, mj^Vin, n))-bimodule with o as scalar mul- 
tiple operation. 

That composition on V{n, n) is 7^(0, 0)-bilinear is not directly a PROP axiom, 
but is still quickly verified, as 

{r®a)oh = r®ao 0(1°) ®h= (r o 0(1°)) (a o 6) = r (g) (a o 6) = 

= (0(1°) or) ®{aoh) = 0(1°) ®aor®h = ao{r®h) 

for all r G P(0, 0) and a, 6 G V{n, n). 

Algebras can also be built using the tensor product of a PROP. For any 
7?.-linear PROP V, the three sets 

^=07^(n,O), i3=07^(n,n), ^=0^0,^) 

neN neN neN 

are all associative, unital, graded 7?.-algebras with ® as multiplication oper- 
ation. The issue of whether A above is generated in degree 1 figures in the 
following theorem. 

Theorem 2.14. Let TZ he an associative and commutative unital ring. Let V 
be an TZ-Unear PROP with elements m G P(l,2), u G P(1,0), D G P(2, 1), 
e G P(0, 1), and A G P(l, 1) such that 

mom® 0(1^) =mo 0(1^) ®m D® 0(1^) oD = 0(1^) ®DoD 

mo-u(g)0(l^) = 0(1^) e(g)0(l^)oD = 0(|i) 

mo0(|i) ®M = 0(|i) 0(|i)(8)eoD = 0(|i) 

D om^m®mo 0(1^ ★ ^X^ ★ 1^) o e o = 0(1°) 

o e = m o 0(|-^) (g) o m o A 0(1^) o D = o e. 

//T' is such that the TZ-algebra 0„gis}'P(^, 0) with <S) as multiplication is gen- 
erated in degree 1, then V{1, 0) is a Hopf algebra overV{0, 0) with operations 



a • b 


— m o a <S> b 


for all a,be 7^(1,0), 


ra 


— r <S> a 


for all r G V{0, 0) and a 


V 


= u, 




A(a) 


^Doae 7^(1,0) ^ 


5 7^(1,0) for alia eV{l,0), 


e{a) 


= eoa G 7^(0,0) 


for all a G 7^(1,0), 


S{a) 


— Ac a 


/or allae 7^(1,0). 
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Proof. Since 0„gN^('^'O) is generated in degree (i.e., coarity) 1, it follows 
in particular that every element of V{2, 0) can be written as ^^^^ ®Ck for 
some {hk]l=^,{ck]l=^ C P(1,0), which means P(2,0) = P(l, 0) ® P(l, 0). 
Hence A indeed maps P(1,0) into 7^(1,0) ® P(1,0), as a coproduct is sup- 
posed to. 

That the axioms for a Hopf algebra hold follow directly from conditions 
in the theorem. □ 

Is this "theorem" anything but a mildly contorted restatement of the 
definition of a Hopf algebra, though? Perhaps not, but there is a point to it: 
the techniques presented in this paper make it trivial to construct any number 
of PROPs V satisfying the list of equations in the theorem, and any list of 
additional equations that one might want to impose, but this need not yield a 
Hopf algebra in the classical sense if it fails to meet the final condition about 
the nullary components being generated in coarity 1. 

One more PROP that will be of interest is the following biaffine PROP, 
so named because it contains both the PROP of affine transformations (like 
some TZ'^* is the PROP of linear transformations) and its dual (which could 
perhaps be called a PROP of "coaffine transformations", even though that 
begs the question of what is being transformed). This extension of the ordi- 
nary matrix PROP introduces nontrivial elements with arity or coarity. 

Example 2.15 (Biaffine PROP). Let TZ be an associative unital semiring. 
The biafRne PROP Baff(7^) over TZ can be defined as the subset of TZ*^* 
of matrices on the form 



where A e 7^'"^", b e 7^'", c e 7^", and d e TZ, (2.14) 



1 


d 







1 








b 


A 



I.e., 



Baff(7^) = {t E 7^•^• 



an-x'iT) ^ 2, Tn = 1, = if z 1, 
ujt^...{T) ^ 2, T22 = l, T2, =0ifjV2 



(2.15) 

The A, b, c, and d parts of (12.141) may be described as the matrix, vector, 
covector, and scalar respectively parts of this PROP element. 

BaS(7Z) is not a sub-PROP of IZ*^* , since the arities and coarities are 
distinct. Concretely, 

«Baff(7^) (7") = a7^•x•(7') - 2, WBafiCR,) (7") = u;7^•x•(T) - 2 (2.16) 
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for all T G Baff(7^). The composition operation on Baff(7^) is however the 
same as in TZ*^': 

"1 di + cjh2 + d2 cjA2 + cj" 
1 ; (2.17) 

bi + Alba A1A2 

and the permutation maps for Baff(7^) can be defined in terms of those for 

"10 

-k a) 



'1 


di 


T"l 




"1 


c/2 


T"l 
C2 







1 











1 










bi 


A, 







b2 


A2 





1 




(2.18) 



'1 


di 


T"l 




'1 


d2 


C2 





1 










1 








bi 


Ai 







b2 


A2 



1 


di + d2 


T 


C2 





1 











bi 


Ai 








b2 





A2 





()7^.x.(or) 

for all permutations a. What is not possible to state purely in terms of its 
IZ*^' counterpart is the tensor product, since the definition 



(2.19) 



of this puts more than one nonzero block in some rows and columns. There 
are nonetheless strong similarities between the two operations, and if one 
denotes the tensor product of IZ*^* by © then it may in particular be 
observed that -<^{A) = (J?) © A is an embedding of TZ"" in Baff(7^); 
^{Ai ® A2) = (J?) © © = *(Ai) © ^(^2) and ^(Ai o A2) = 
(01)© A1A2 = "^{Ai) o \E'(A2). This suffices for verifying the permutation 
composition and juxtaposition axioms. 

The composition associativity and identity axioms follow from the fact 
that these hold in TZ'^'. The tensor product associativity and identity axioms 
are obvious from (12.191) . The two remaining axioms are straightforward to 
verify through explicit calculations, e.g. 




C3b4 + d2 + d^ 



1 


ds 


T"l 




"1 


(^4 


T"l 
C4 







1 











1 





) 





b3 


As 







b4 


A, 





d-s + cjb4 + d4 



C3M. 



4 + cj 



bs + A-shi 
cjA2 + c^ cjA^ + c 





A3A4 






1 











bi + Albs 


A1A2 








bs + Ashi 





A3A4 
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1 di + (is 


T"l 

Ca 




1 d2 + d4 


T 


T" 










1 










o 





1 
















bi 










b2 


A2 













ba 







Aa. 







b4 





A,_ 








"1 


di cf 




'1 


ds 


T" 

Ca 




'1 d2 


T" 

C2 




'1 


d^ 


T 





1 







1 





o 


1 










1 








bi A,_ 







ba 


^3 




b2 


A2 







b4 


A, 



An observation about the biaffine PROP which is useful when evaluating 
complicated expressions is that it can be thought of as counting paths in 
a network. The elements of the matrix part keep track of paths passing 
through it, entering through the input corresponding to the column and 
exiting through the output corresponding to the row. The elements of the 
vector part keep track of paths which begin within the network but leave 
it, with a separate row for each output, and conversely the elements of the 
covector part keep track of paths which enter the network but terminate 
within it, with a separate column for each input. Finally the scalar part keeps 
track of paths which both begin and end within the network, never leaving 
it. It is not hard to see that the composition law corresponds precisely to 
composing two networks such that the inputs of the left factor are identified 
with the outputs of the right factor, and the tensor product law corresponds 
to putting two networks next to each other. 

3 Relations 

Rewriting theory makes a greater use of relations as mathematical objects 
than many other branches of mathematics; this is in part due to that it 
operates in a setting where very little is given in terms of operations and 
their properties, so one has to make do with more fundamental and generic 
concepts. Two types of relation that will be of particular interest here are 
congruence relations and partial orders. Congruence relations, as the name 
suggests, can express the property that two expressions are congruent modulo 
some set of given identities. Partial orders are used to encode the fact that 
one expression is "simpler" than another. Frequently these types are unified 
into a rewriting relation — where 'a — )• 6' might be interpreted as 'a is 
congruent to b, but the latter is simpler' (on account of being the result of 
applying a single step reduction to a). However, in that particular role the 
rewriting formalism of [S] employs maps rather than relations, so that is not 
a unification that will be made here. On the other hand, it turns out that 
both congruence relations and the partial orders of interest may be defined 
as special cases of PROP quasi-orders, which saves some work below. 
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As usual, a binary relation P on some set S is considered to be a subset of 
SxS, but {x, y) e P is often an impractical (and opaque) piece of notation for 
the common case of order relations, so instead I'll typically write ^ y in P' 
to mean the same thing. This notation has the advantage of clarifying for 
the reader that it is x that is on the "small side", and it also allows the 
variations 

y ^ X in P, 

X ^ y in P and y ^ x in P, 
y < X in P, 

X ^ y in P and y ^ x in P 

without introducing any new per-relation symbols. If several such relations 
appear in sequence, e.g. x ^ y < z in P, then this is primarily to be read as 
a shorthand for the conjunction of the individual relations, i.e., 'x ^ ?/ in P 
and y < z in P\ but transitivity may of course permit one to also draw 
conclusions about the relation between nonadjacent steps. If P is a partial 
order then a; ~ j/ in P is the same thing as x — y, but if P is a more general 
quasi-order then this need not be the case. Quasi-ordcrs arc of interest in that 
context because they often occur as intermediate steps in the construction 
of specific partial orders. 

A quasi-order P is an equivalence relation if and only if it is symmetric. 
The P-equivalence class [xjp of x e S is the set of all y e S such that 
X ^ y in P. The quotient of S by an equivalence relation P is denoted 
S/P, and is as usual the set | [xjp | a; G 5 } of all P-cquivalence classes. 

Let T 'Z S. An element a; G T is said to be P-minimal in T if there 
is no 1/ e T such that y < x in P. The quasi-order P is said to be well- 
founded if every nonempty T C. S contains an element which is P-minimal 
in T. Well-founded quasi-orders support induction arguments of the form 

if P C 5" has the property that 

X e P whenever all y < a; in P satisfy y & R, 

then S; 

the proof is to consider T — S \ R, since if that had been nonempty then it 
would contain a P-minimal element x, which would contradict the hypoth- 
esis. Well-foundedness is also known as satisfying the descending chain 
condition; a descending chain is then an infinite sequence {xi}'^^ C S such 
that Xi ^ Xi-^i in P for all i e Z+, and the condition is that there must 
be some n such that Xn ^ Xi in P for all i ^ n. Alternatively one may 



X y m P 
X < y in P 
X > y in P 
X ^ y in P 
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state it as: there are no infinite strictly P-descending chains — any sequence 
Xi > X2 > ■ ■ ■ in P must terminate after a finite number of steps. This form 
is convenient when proving that something is an algorithm, since any loop 
where at each iteration some quantity strictly P-decreases must be finite 
when P is well-founded. 

Definition 3.1. An N^-graded quasi-order Q on an N^-graded set P is a 
quasi-order such that ii x va.Q then a{x) = a{y) and u{x) = u{y). It is 
sometimes useful to let Q{m,n) denote the restriction of Q to V{m,n). 

A PROP quasi-order Q is an N^-graded quasi-order on a PROP V which 
is compatible with the PROP operations, i.e., firstly 

a m Q{l^m) =^ c o a o d ^ c o b o d in Q{k,n) (3.1a) 

for all a, 6 G V{1, m), c E V{k, I), and d G V{m, n), and secondly 

a^bmQ{kJ) =^ c®a®d^c®h®dinQ{i + k + m,j + l + n) (3.1b) 

for all a, 6 G V{k, I), c E V and d G P(m, n), for all i, j, A;, /, m, n G N. A 
PROP quasi-order is called a PROP congruence relation if it is symmetric, 
i.e., if a ^ 6 implies a ^ b. It is an 7^-linear PROP congruence relation if V 
is 7?.-linear and additionally for any m,n E N, r E TZ, and a,b,c E V{m,n) 
such that a ~ 6 in Q{m,n) it holds that ra ~ rb in Q{'m^n) and a + c ~ 
6 + c in Q{m, n). 

A PROP quasi-order Q is said to be strict if the PROP operations preserve 
strict inequalities, i.e., if firstly 

a <b m Q{l^m) =^ c o a o d < c o b o d in Q{k,n) (3.2a) 

for all a,b E V{1, m), c E V{k, I), and d E V{m, n), and secondly 

a<binQ{k,l) =^ c^ai^d < c^bi^d in Q(i + k + m,j + l + n) (3.2b) 

for all a,b E V{k, I), c E Vii^j), and d E V{m, n), for all k, l,m,n E N. 

N^-graded partial orders, PROP partial orders, and strict PROP partial 
orders are ditto quasi-orders which additionally are partial orders on the 
underlying set. 

The strict PROP partial order concept is a generalisation of the monoid 
partial order concept, and will play a similar role in the theory. Unlike 
the case with monoids however, there are no strict PROP total orders, and 
with the exception of certain degenerate PROPs (such as that in Exam- 
ple 12. 7|) there cannot even be PROP partial orders that are total within each 
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component. The reason for this is that any two elements that differ only 
by action of permutations have to be incomparable or equivalent, since if 
it could happen that a < a o 0(r) then it would follow from fl3.2ap that 
a < a o (pij) < a o 0(r) o 0(r), and thus by extension that a < a o cpi^r"') 
for every n > 0, but because every permutation has finite order there exists 
some n > for which r" is the identity, and from that one would get the 
contradiction a < a. Still, examples of strict PROP orders are not entirely 
trivial to construct, so for a first example of strictness one may be best off 
with the following, even though it is "degenerate" in the sense of mapping 
all permutations to the same thing. 

Example 3.2. Let M be a commutative monoid. Build from it an N^- 
graded set V by making V{n,n) = M for all n G N and V{'m,n) = if 
m ^ n. Define a PROP structure on V by making 0ri(o") = 1 G V{n,n), 
a o b := ab E V{n, n), and a ^ c := ac & P(m + n,m + n) for all cr G 
a, 6 G V{n, n) and c G P(m, m). The axioms are trivial to verify. 

Let / : V — y M be the map which forgets arity and coarity of elements. 
If Q is a monoid quasi-order on M then the binary relation PonV defined 
by 

a ^ 6 in P <^==^ a{a) = a{b), w(a) = and /(a) ^ f{b) in Q (3.3) 

is a PROP quasi-order. If a < 6 in Q implies ac < be in Q for all c G M then 
P is a strict PROP quasi-order. 

A PROP which is not "degenerate" in the above sense of treating all 
permutations like the identity, and which comes with a strict order, is the 
"connectivity PROP" below. The reader may however prefer to skip over it on 
a first read-through, since even though it can be defined in quite elementary 
terms, the explanation of what is being compared and why the definition 
yields a PROP relies rather heavily on the network notation of Section \5\ and 
its close relationship with the free PROP (Section [8]). 

Example 3.3 (Connectivity PROP). For any m,n G N, let C(m, n) be the 
set of all pairs (P,c), where c G N and P is a partition of L{m,n) := 
({0} X [m]) U({1} X [n]), i.e., P is a set of pairwise disjoint subsets of L{m,n) 
whose union is the whole of L{m,n). Let (Pi,ci) ^ (P2,C2) in P{m,n) iff 
ci ^ C2 and there for every Ai G Pi exists some A2 G P2 such that Ai ^ Ai\ 
as a poset, this implies C{m,n) is isomorphic to the cartesian product by N 
of the partition lattice for an (m + n)-set. An element of C{m,n) is more 
connected the more elements of L{m, n) are in the same block of the partition. 

As it happens, this natural number part makes it possible to turn C{m, n) 
into a PROP on which P is a strict partial order. The idea of this PROP is 
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to keep track of the connectivity of the graph underlying an expression, but 
it can be defined entirely in the terms of Definition I2.4t 



For any a G S^, 



(0,a(j)),(l,j)) 



jE[n] ,0 



i.e., the partition consists of n blocks of two elements each — item (1, j) 
goes with item (O, cr(j)) — and the c part is 0. 

The tensor product 

(El, ci) ® (52, C2) := (5i U B'^, ci + C2), 

where B'2 is B2 shifted so that it becomes disjoint from Bi; if {Bi, ci) G 
C{kJ), then 



5^= {{ (0, A; + z) I (0, G A } U { (1, / + j) I (1, j) G ^ }} 



AG-B2 



• Finally, if (-Bi,Ci) G C{l,m) and (-82? C2) G C{m,n), then 

(5i,ci) o (52,C2) := (5',ci + m+ |5| - - IB2I +C2), (3.4) 

where -B and -B' are obtained by taking a transitive closure of Bi and 
E2. In more detail, let S = ({0} x [/]) U ({i} x [m]) U ({1} x [n]). 
Let i?i be the equivalence relation on S for which {x,i) ~ (2/,j) iff 
(i) {x,i) = {y,j) or (ii) (2x,i) and {2y,j) are in the same block of Bi, 
this leaves every (1, j) G 5* in a singleton equivalence class. Similarly 
let E2 be the equivalence relation on 5* for which {x,i) ~ {y,j) iff 
(i) (x, = (y, j) or (ii) (2x — 1, i) and {2y — 1, j) are in the same block 
of B2; here it is instead the (0, j) G S which end up as singletons. Let E 
be the transitive closure of E1UE2, and let B be the set of equivalence 
classes of E. Let B' be the set of equivalence classes of the restriction 
of E to L{l,n). 

Explanation. In order to understand what is going on here, it is convenient 
to introduce an auxiliary N^-graded set Q of "graphs with terminals"; an 
element of Q{m,n) consists of one pseudograph G (i.e., it may have loops 
and multiple edges, although one could make do without them) and two lists 
of m and n respectively vertices (where one does not need to require the 
vertices to be distinct, although one could do so). Apart from these lists, the 
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graph is unlabelled; one may freely rename vertices and edges, as long as the 
lists are updated accordingly. Denote by Ui{G) the i'th vertex (i e [m]) in 
the first list of G and by Vj{G) the j'th vertex (j e [n]) in the second list of 
G. 

There is a natural definition of the PROP operations on Q. Both when 
forming the composition Ho — G^o G2 and the tensor product — Gi®G2 
of Gi G Q{k,l) and G2 G Q {171,11), one starts by forming the disjoint union 
G = Gi U 6*2 of Gi and G2 (this is where relabelling vertices and edges tends 
to become necessary, but we'll assume the labellings started out disjoint). As 
a pseudograph, H,^ = G, and the lists of vertices are given by 

jv4G^) iii^k, /...(Gi) iij^l, 

\ui-k\G2) otherwise, \vj^i{G2) otherwise 

for all i E [A; + m] and j G [/ + n]. The composition Ho is instead G + 
[vj{Gi)uj{G2)}'J^^ — i.e., G with m — I extra edges connecting the Gi and 
G2 parts — then taking the first list from Gi and the second from G2, so 
that Ui{Ho) = Ui{Gi) and Vj{Ho) = Vj{G2). Finally, (/)„(o") is a graph with 
vertex set {0, 1} x [n], fists given by Ui = {0,i) and Vj = (1, j), and n edges 
connecting with (0,a{j)) (i.e., the graph 0n(c) is a matching). Q 

is not quite a PROP under these operations — for example the composition 
identity axiom fails — but it is pretty close, and would be a PROP modulo 
graph homeomorphism. 

One graph invariant that is relevant for this discussion is the cyclomatic 
number cyc(G), i.e., the dimension of the cycle space (or for the more topo- 
logically oriented, the rank of the homotopy group). In a graph G, the easiest 
way to compute this is to first fix a maximal spanning forest, and then simply 
count the number of edges not in the forest; every such edge must connect 
two vertices in the same component of G, so there is a unique path between 
them in the forest, and together with the edge this path forms a cycle. The 
set of such cycles constitutes a basis for the cycle space, the dimension of 
which is therefore equal to the number of edges outside the forest. It is well 
known that the number of edges in a tree is one less than the number of 
vertices. The corresponding result for a forest is that \E\ = \V\ — k, where k 
denotes the number of components. Hence cyc(G) = |£^(G) | — |l/(G) | + A;(G). 
Applying this to the o operation, one finds that 

cyc(Gi o G2) = I E{Gi o G2) I - I V{Gi o G2) | + A;(Gi o G2) = 

= \E{Gi)\+m+\E{G2) \ - \V{Gi)\ - \ V{G2)\ + k{Gi o G2) = 

= cyc(Gi) - k{Gi) +m + cyc(G2) - k{G2) + k{G, o G2). 
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If one makes the interpretation of the connectivity PROP C that the B part 
of an element is its set of components, then this formula is exactly the c 
part of (13. 4p ! What the tensor product and permutations do with the c 
part also coincides with what happens to the cyclomatic number, so the 
connectivity PROP may in fact be viewed as a destination of Q down to the 
minimal amount of information needed to keep track of what happens to the 
cyclomatic number under PROP operations. It is because both the B and c 
parts can be considered properties of elements of the free PROP that C must 
be a PROP. 

From the PROP order construction point of view, it is however rather the 
component partition B that is primary, whereas the integer c is something 
extra that has to be put in to make the order strict. It is very natural to order 
expressions by how much different parts of them are interconnected, as an 
expression with fewer connections has fewer restrictions on how its parts can 
be rearranged, and is therefore simpler. A natural measure of connectivity 
is the partition of inputs and outputs into components, but an order by this 
alone will not be strict: if a(yu) = w(A) = 2, ^(/i) = u{u) = a(A) = 1, 
and a{u) = then /i o 0(1^) u and /i o A both have the input connected to 
the output, but 0(1^) ® u is less connected than A, so a strict order should 
make fi o 0(1^) ^ u < fi o A. Such a distinguishing detail can be hidden 
away deep within a large expression, but remarkably enough the cyclomatic 
number suffices as a way of remembering the difference. □ 

Quite a lot of useful orders can be constructed by comparing the images of 
elements under some map to a different set (usually a "simpler") set. Hence 
a definition may be in order. 

Definition 3.4. Let sets A and B, a map /: A — > B, and a binary relation 
P on i? be given. The pullback of P over / is then the binary relation f*P 
on A defined by 

X ^ y in f*P <^==^ f{x) ^ f{y) in P for all x,y E A. (3.5) 

The (set-theoretic) kernel Ker / of / is the relation f*E, where E denotes 
the equality relation on B. 

The more traditional algebraic kernel ker / of a homomorphism /, which is 
generally the Ker / equivalence class of 0, is not as immediately applicable for 
PROPs since the most common way of developing its theory relies on having a 
group structure, and not even linear PROPs are groups in that way. One can 
however define the algebraic kernel as the N^-graded set of all equivalence 
classes of (noticing that there is a separate in each component) and 
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then go on to prove that it is a sub-PROP, after which the theory develops 
as one would expect. Working instead with relations has the merit that 
this observation is automatic (and in addition it works also for non-linear 
props). 

Lemma 3.5. Let N'^-graded sets V and Q, a map f : V — )■ Q, and a binary 
relation Q on Q be given. Consider the pullback f*Q of Q to V . 

1. If Q is reflexive then f*Q is reflexive. 

2. If Q is symmetric then f*Q is symmetric. 

3. If Q is transitive then f*Q is transitive. 

4. If Q is an N'^-graded quasi-order and f is an N^-graded set morphism 
then f*Q is an N'^ -graded quasi-order. 

5. If Q is a PROP, Q is a PROP quasi-order, V is a PROP, and f is a 
PROP homomorphism then f*Q is a PROP quasi-order. If in addition 
Q is strict then f*Q is strict. 

6. If Q is well-founded then f*Q is well-founded. 

Proof. Reflexivity, symmetry, and transitivity are trvial; for example if a ^ 
b in f*Q and 6 ^ c in f*Q then by definition /(a) ^ f{b) in Q and f{b) ^ 
/(c) in Q, from which follows /(a) ^ /(c) in Q by transitivity, and hence 
a ^ c in f*Q as required for f*Q to be transitive. Similarly for N^-grading: if 
a ^ 6 in f*Q then /(a) ^ f{b) in Q and hence a{a) = Q;(/(a)) = «(/(&)) = 
a{b) and cj(a) = cj(/(a)) = a;(/(6)) = u{b) as claimed. 

Proving that /* is a PROP order requires a bit more work, but if a ^ 
b in f*Q then /(c ® a ® rf) = /(c) ® /(a) ® f{d) ^ f{c) ® f{b) ® f{d) = 
f{c®b<Sid) in Q since /(a) ^ f{b) in Q, and hence c(8)a®o? ^ c®b<Sid in f*Q. 
The same argument works for composition. 

Then there is the matter of strictness. If f*Q is not strict, i.e., if a < 
b in f*Q but c <^ a ^ d ^ c <S) b <^ d in f*Q for some a,b,c,d G V then 
c(^a<S)dr^c(^b<S>d in f*Q and hence /(c) ® /(a) f{d) = f{c ®a®d)r^ 
f{c®b®d) = f{c)®f{b)®f{d) in Q. Since /(a) < f{b) in Q, this implies Q 
isn't strict either. Again the exact same argument applies for composition. 

Finally for well-foundedness, let T C P be an arbitrary nonempty set. 
Then /(T) is nonempty, and hence it contains some Q- minimal element f{x) 
for X E T. This x is then f*Q-mimmal in T, since had some y E T satisfied 
y < X in f*Q then it would follow that f{y) < f{x) in Q, contradicting the 
minimality of x. □ 
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Lemma 3.6 (First isomorphism theorem). Let V be a PROP and C a PROP 
congruence relation on V . Then V jC is a PROP with 

"p/c(Hc) = a-p{a), wp/c(Hc) = 

[a]c ®r/c [h]c = [a ®v h]c, He °v/c [h]c = [a o-p h]c, 

for all a,b & V and permutations cr. Moreover f: V — > V/C defined by 
f{a) = [a]c is a PROP homomorphism. 

Conversely let g: V — > Q be a PROP homomorphism. Then Ker g is 
a PROP congruence relation. Let /: V — > V/Keig be defined by f{a) = 
Hxcrg for all a E V. Then there exists a unique map h: V / Ker g — > Q 
such that g = ho f J and that h is a PROP monomorphism. If g is surjective, 
then h is an isomorphism. 

Proof. That the a, u, o, and ® of V/C are well-defined follows from the 
definition of PROP congruence relation. That they satisfy the axioms of a 
PROP is shown through the usual exchange of operations and equivalence 
class brackets; for example the permutation composition law follows from 

= [0p(o-) Op (/)p(r)]^ = [(ppiar)]^ = (/)p/c(ar). 

That /: V — > V/C is a PROP homomorphism is literally the definition 
of V/C. 

That Ker g is a PROP congruence relation follows from Lemma 13.51 The 
defining property of h: V / Kei g — v Q is that h(^f{a)) = g{a) for all a E V, 
and h is well-defined and injective since /(a) = f{b) iff a ~ 6 in Ker g, which 
by definition is equivalent to g{a) = gib). That / is surjective means h is 
completely determined by this. That his a. PROP homomorphism is another 
exchange exercise; for ® is amounts to 

h[f{a) ® fib)) = h{fia ® b)) = gia ®b)= gia) ® gib) = /i(/(a)) ® h{fib)) 

for all a,beV. □ 

This lemma thus establishes for PROPs, through elementary means, the 
basic principle of universal algebra: that an arbitrary PROP Q may be viewed 
as (is isomorphic to) a quotient of a preferred PROP V, if only one can con- 
struct a surjective homomorphism from V to Q. The elementary construc- 
tion of a free PROP, which as usual comes with homomorphisms to arbitrary 
PROPs, is the subject of Section [HI 
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Construction 3.7. Let 5 be a set. Define a binary operation o on binary 
relations P, Q S x S hj 

P o Q = (x,y) E S X S \ X < y in P, or X ^ y in P and x ^ y in . 

(3.6) 

This operation is associative and it is called the lexicographic composi- 
tion. The lexicographic composition of two quasi-orders is itself a quasi- 
order. The lexicographic composition of a quasi-order and a partial order is 
a partial order. 

If iS is a PROP, and P and Q are strict PROP quasi-orders, then P o Q 
is a strict PROP quasi-order too. If P and Q are well-founded then P o Q is 
well-founded as well. 

Remark. Some strictness condition for composing PROP quasi-orders is nec- 
essary, since iix < y in P but for example xoz yoz in P then x ^y in PoQ 
regardless of Q, but whether xoz^yozinPoQ depends entirely on Q. 

In [13], the lexicographic composition is instead called the ^-product. 

The lexicographic composition is similar to the 'ordinal product' of two 
posets p. 101], which is a generalisation of multiplication of ordinal num- 
bers; the main difference is that the ordinal product also forms a cartesian 
product of the underlying sets, whereas the this lexicographic product pro- 
duces a new relation on the same underlying set. 

Proof. First assume P and Q are quasi-orders on S. To see that PoQ 
will then be reflexive, it suffices to notice that since P and Q are reflexive, 
X ~ X in P and x ^ xinQ for all x E S. To see that PoQ will be transitive, 
note that 

X ^ y in P o Q <^=^ {x ^ y in P) A ((x ^ y in P) =^ [x ^y in Q)) 

for all x,y E S. Hence if x ^ ?/ in PoQ and y ^ z in PoQ for some x,y,z E S, 
then X ^ y in P and y ^ z in P, and thus x ^ z in P. Furthermore the 
assumption that x ^ z in P leads to x ^ ?/ in P and y z in P, hence 
X ^ y in Q and y ^ z in Q, and thus x ^ z in Q. The above equivalence 
now implies that x ^ z in P o Q, as required. 

If P is a partial order and Q is reflexive then it is easy to see that PoQ = P 
and thus P o Q is trivially a partial order. To see that it is a partial order if 
P is a quasi-order and Q is a partial order, note that 

X ^ y in P oQ <^=^ x ~ y in P and x ~ ?/ in Q 

for all x,y E S. Since x ~ ?/ in Q by assumption implies x = y, it follows 
that X ~ 2/ in P o Q implies that as well. 
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Let x,y G S and P,Q,R S x 5 be arbitrary. Then it follows from the 
equivalence 

X ^ y in P o {Q o R) <^=^ 



that o is associative. 

Finally there is the matter of whether P o Q is a strict PROP quasi-order 
when P and Q are. First, Po Q is clearly N^-graded since it can only relate 
pairs of elements already related by P. 

In order to establish compatibility with composition ( (13. lap and fl3.2al) ). 
one must consider three cases for a,b G S{l,m), c E S{k, I), and d G S{m, n). 
The first is that a < h in P o Q because a < 6 in P, in which c o a o d < 
cobodin P and hence coaodKcobodinPoQas required. The second is 
that a < b in P o Q despite a ~ 6 in P, in which follows that a < b in Q and 
hence coaod < cobod in Q. By using (13. lap twice, since '~' is and it 
also follows that coaod^cobodinP,so again coaod < cobod in PoQ as 
required. The third case is merely that a ~ 6 in P o Q, in which it similarly 
follows from a ~ 6 in P and a ~ 6 in Q that coaodr^ cobod in P and 
coaodr^ cobod in Q, so that coaod^ cobod in PoQ, which is the 
required conclusion in that case. Compatibility with the tensor product is 
proved in exactly the same way. 

Finally, there is the matter of well-foundedness. Let T C 5 be an ar- 
bitrary nonempty set. Let T' be the set of P-minimal elements in T; this 
is nonempty by the well-foundedness of P. Hence there exists a Q-minimal 
element x in T' . There cannot be a ?/ G T such that y < x in P oQ, because 
y < X in P would contradict the P- minimality of a; in T, and y ~ x in P 
would imply that y is P-minimal in T, meaning y E T', and then y < x in Q 
would contradict the Q-minimality of x in T' . Hence x is (P o Q)-minimal 
in T, and thus P o Q is well-founded. □ 

4 Abstract index notation 

Recall the Einstein notation for tensors, under which 



(x < y in P) V ((x ~ ?/ in P) A (x ^ ?/ in Q o Kf) 
(x < y in P) V ((x ~ ?/ in P) A (x < y in (5))v 




d = A)Bi is a shorthand for Cl = Y^ A)Bi 
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and superscripts are not exponents, but like subscripts used as indices into 
the base symbol. The abstract index notation is a generalisation of this, 
which follows the same syntactic principles but is given a more abstract 
interpretation as a shorthand for some combination of compositions, tensor 
products, and permutations. Nonetheless the reader may find it instructive 
to make direct Einstein notation interpretations of expressions, and in the 
case of l-iomy PROPs both interpretations are equally valid, especially when 
V is finite-dimensional (e.g. a finite-dimensional Hopf algebra). 

A point of view that is convenient when understanding the abstract index 
notation (and even more the network notation, below) is that a PROP element 
7 of arity n and coarity m may be thought of as a black box which takes n 
inputs and produces m outputs. Composite PROP elements are formed by 
connecting outputs from one factor to the inputs of another. In order to keep 
track of these connections, every input and output is given a separate label 
(the 'abstract index' symbol), and when the same label occurs for an output 
as for an input, then these are connected. Those inputs of a factor which 
are not connected to any output of a factor become inputs of the expression 
as a whole, whereas those outputs that are not connected to any input of a 
factor become outputs of the expression as a whole. 

By convention in the case of the Einstein notation, output labels (row 
indices, signalling a vector aspect of the tensor) are written as superscripts 
of factors and input labels (column indices, signalling a covector aspect of the 
tensor) are written as subscripts of factorsjf] so if 7 has arity 3 and coarity 2 
then it might appear in abstract index notation as the labelled factor 7"^^. A 
naked expression in abstract index notation is simply a product of labelled 
factors (satisfying some syntactic conditions), but from a formal point of 
view it is more convenient to start with dosed expressions, and introduce 
naked expressions as a relaxation of these. A closed expression in abstract 
index notation has the form 

inputs I olabels _ _ _ / labels] 
outputs I Plabels ' ' ' relabels J 

where /3 through are PROP elements and the various 'labels', 'inputs', and 
'outputs' are finite lists of (variable) symbols satisfying the arity, matching, 
and acyclicity conditions detailed below. In this notation, the antipode axiom 
can be written as 

[I I ^^l,S:^f] = I r/^e,] = [I I ^l.St^':] . (4.2) 

This convention has been used by Penrose [12 and in much physics Uterature, whereas 
for example Cvitanovic [1] uses the opposite convention. It doesn't matter terribly much 
which convention is used as long as one stays within one notation system, but it becomes 
very noticable if one e.g. mixes abstract index notation with categorical notation. 
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(4.1) 



The complete bracket construction denotes a PROP element, whose arity 
is the number of inputs and whose coarity is the number of outputs. The 
corresponding naked expression is 

^I'^Sl^f = rfsa = /x^^f Ar, (4.3) 

i.e., just the product parts (between a bar and the following right bracket) of 
the closed expressions. An equality of two closed expressions can be abbrevi- 
ated as an equality of the corresponding naked expressions if the input and 
output lists are the same; conversely any naked expression equality can be 
turned into an equivalent closed expression equality by wrapping the terms up 
in brackets with equal input and output lists. (It follows from Lemmas 14.61 
and 14.71 that when closing a naked expression equality, every syntactically 
correct choice of input and output lists produces an equivalent equality of 
closed expressions.) A complication when going from closed expressions to 
naked expressions is however that one side of an equality might have the 
same label both as input and output, whereas the other side does not: 

[a I l^trf] = K I 1] • 

In these cases, it may be necessary to insert extra identity factors in the 
naked expression form, just to switch label. In traditional Einstein notation, 
such identities would be Kronecker deltas, so with 6 := 0(1^) as this kind of 
identity, the naked counterpart of the above is 

From Section [7] and on, the symbol \] starts being used in the context of the 
network notation very much as the Kronecker delta is used in the abstract 
index notation, so arguably it might have been better to pick either one and 
stick with it, but offering familiar notation also has its merits. 

When transcribing an expression between network and abstract index 
notation, one may at times feel confusion as to how up and down corre- 
spond to in and out; this is mostly due to the abstract index notation being 
basically one-dimensional (a line of text), whereas the network notation is 
two-dimensional (a diagram). A good principle to keep in mind is that con- 
nections go down, from a superscript to a subscript. Conversely "data" go 
"back up" to the top of the line when a factor "processes" it. An image can 
be that an abstract index expression is somewhat like a network notation 
expression that has been rolled up on a transparent rod the size of a line of 
text, in such a way that all the factor are on the far side, whereas connec- 
tions between them are on the near side — that's why the in/out /up/down 
relationships are different. 
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For PROPs that support operations beyond tensor product and composi- 
tion, particularly addition and multiplication by scalar, the naked notation is 
(in analogy with the Einstein notation) often extended to support also these. 
Hence one might write 

Af r = i^Tf + + 

shorthand for 

U I r] = U I Cv'] + 2 I cC] + U I vx'] ' 

i.e., in each term the labelled product part becomes a separate closed ex- 
pression. Tensor product and composition both appear as "multiplication" 
in the naked notation, but one can tell them apart by looking at the labels; 
Theorems 14.81 and 14.101 formally establishes this correspondence. 

One feature commonly introduced as part of the abstract index notation, 
but which SHALL NOT be assumed here, is that of "raising and lowering in- 
dices": that one from any m° can manufacture a corresponding Ua and vice 
versa. (A consequence of this is that there is no sense in which a superscript 
comes before or after a subscript; only the relative order of superscripts 
among themselves, and of subscripts among themselves, have significance.) 
Even in contexts where such raising and lowering of indices is in common 
use, it tends to merely be a shorthand for composition with two specific el- 
ements — usually the metric (i.e., the inner product) and its inverse — from 
the (0, 2) component (for lowering) and (2, 0) component (for raising) respec- 
tively. Hence there is no need for that feature in the generic abstract index 
notation. 

A feature which is left for future extensions is that of allowing differ- 
ent indices to "range" over different sets — e.g. a typical formulation of the 
Lagrangian for the Standard Model of elementary particle physics would typ- 
ically sport not only Lorentzian (space-time) indices, but also spinor indices, 
flavour indices, colour indices, and quite possibly some more types still (de- 
pending on how much the author seeks to compress the expressions); these 
must all be kept apart. Distinguishing several different types of index would 
correspond to a generalisation from PROPs to (strict) symmetric monoidal 
categories (with free monoid of objects). While this would certainly be worth 
while if one's primary aim were to establish the notation system as such, it 
would also be a technical complication, and the issue is largely orthogonal to 
what is relevant for rewriting. Hence this text is better off without it. 

When expressing rewrite rules in abstract index notation, it sometimes 
also becomes necessary to go beyond what can be formalised for abstract 
PROPs, to make a statement to the effect that "this holds even if this abstract 
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index expression is extended with extra labelled factors that make input e 
depend on output a" , which is the meaning of the a e in 

/i^^ si Af Af ^ 5J 51 where a rx e. 

The formal background for this practice here can be found in Section and 
page I16H but informally it may be viewed as a statement that certain "trace 
maps" exist or are admissible in the situation at hand. 

Finally, it should be observed that one sometimes has to put abstract 
index labels on a PROP element for which the notation already contains an 
ordinary index; one may for example have elements C,i and ^2- In such cases, 
it is advisable to put the abstract indices on a parenthesis around the symbol 
for the PROP element, like so: (Ci)"(C2)^ 



4.1 Formal definition and basic properties 

In the formal claims about the abstract index notation below, lists of abstract 
index labels are denoted by boldface letters, and notation for such lists is 
mostly multiplicative; a list may be viewed as a word on an alphabet of 
abstract index labels. Hence ab is the list consisting of first the elements 
of a and then the elements of b. The notation |a| denotes the multiset of 
elements in a, and ||a|| is the length of a (thus cardinality of |a|). Removal 
of elements is denoted as division: a/b is the list of those elements of a that 
are not in b, always in the same order as in a, whereas their order in b is 
ignored. Because of the matching condition on labels, the lists occurring 
below will not have any repeated elements, so / behaves like division in that 
for example abc/b = ac. The formula b | a ('b divides a') is a shorthand 
for |b| C |a|. Elements in a list of labels, i.e., actual abstract index labels, 
are denoted by lower case latin letters. Upper case letters will sometimes be 
used for products of zero or more labelled factors. Write Nfc(/,m) for the 
list rii- ■ - rik where rii = {i — l)m + /, e.g. N3(l, 2) = 135; this is sometimes 
useful for "automatically manufacturing" disjoint lists of known lengths. 



Definition 4.1. Let ao, . . . , a„ and bo. 



hn be lists. The notation 



a2 



fulfilling the conditions of 
arity: 7^ G V(\\hi\\ , ||ai||) for i 



1 n, 



matching: V := \Y[ 



1=0 I 



43 



acyclicity: there exists a partial order QonV such that x < y in Q when- 
ever X G |bj| and ?/ G |aj| for some 1 ^ n 

denotes an element of ^(llaoll , ||bo||), namely: 

1. [a I = 0m(o"), where m = ||a|| = ||b|| and a G is the permutation 
for which b = ao-(i) ■ ■ ■ aa{m) where Oi ■ ■ ■ := a. 

3. If n ^ 2 then for the smallest 1 such that b^ I ag, 



nr=i(7. 



afc(ao/bfe) 
ao 



'afc 



bo 

afc(ao/bfc) 



nt^(7.)^:nL.+i(7.)^; • (4.4) 



is called the order of this abstract 



The number n of factors in ^° niLi(7i)a- 
index expression. 

In claims, an equality with one or several abstract index expressions in 
the left hand side is to be read as being implicitly conditioned with the 
fulfillment of the corresponding arity, matching, and acyclicity conditions 
for these. When these and all explicit conditions are fulfilled, all abstract 
index expressions on the right hand side must fulfill their arity, matching, 
and acyclicity conditions. 

If comparing this definition of abstract index notation, particularly ex- 
pressions of order such as [2341 | l] 5 to the relation notation (234^) for per- 
mutations, it may seem as though rule [T] runs the permutation the wrong 
way (bottom to top rather than top to bottom), but this is because of a 
more fundamental difference between the two notations. In relation nota- 
tion for permutations, elements in the top and bottom lists are elements in 
the permutation domain and codomain respectively, and two elements are 
linked if they are in the same position. In the abstract index notation, it is 
the positions in the lists that are elements of the permutation domain and 
codomain, and two elements are linked if they contain the same label. This 
duality of list elements and positions explains why the permutation defini- 
tion is reversed; Lemma 14.41 shows that it still behaves as expected (top row 
matched to things on the right, bottom row to things on the left). 



Theorem 4.2. The notation introduced in Definition \4-l\ is well-defined, 
i.e., whenever the three conditions are fulfilled, there is a unique rule which 
assigns a value to the expression. 
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Proof. Rule [T] determines the value of order expressions, rule [2] determines 
the value of order 1 expressions, and recursive application of rule E] deter mines 
the value of all expressions with order greater than 1. 

More precisely, in the order case there is a unique permutation a such 



that a = ai 



and b 



a, 



because lal = Ibl is a set. 



In the order 1 case, one may first observe that |a| U |c| = |ac| = |db| = 
|d| U |b|, and since |b| fl |c| = by the partial order condition, it follows 
that b I a and |d| = |c| U |a| \ |b|. Hence 

|b(a/b)| = |b| U |a/b| = |b| U (|a| \ |b|) = |a| , 
|c(a/b)| = |c| U (|a| \ |b|) = |d| 

and thus all the abstract index expressions in the right hand side of this rule 
are well-defined. Furthermore 
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K I 1] e V{\\h\\ , ||c||) ® P(||a/b|| , ||a/b||) C P(||b(a/b)|| , ||c(a/b 



and so also the compositions are all correct. 

Finally, in the case of order 2 or more, one must first establish the exis- 
tence of some k ^ 1 such that b^ | ao. Let Q be the required partial order 
on the set of all labels V, and define a second partial order P on {1, . . . , n} 
by 

i < j in P <^=^ X ^ y in Q for some x G |aj| and y G \hj\; 

P becomes transitive because Q is transitive and P is antisymmetric by 
the antisymmetry and transitivity of Q. Now consider some j which is P- 
minimal. No x G |bj| can belong to |aj| for any i ^ 1, since that would make 
i < j in P. Hence hj \ slq. 

Next observe that |aoafc| = |ao| U |afc| = |afc| U (|ao| \ |bfc|) U \hk\ = 
|aA;(ao/bfc)bfc|, and so the first abstract index expression fulfills the condi- 



tions. For the second it follows from IJ^ 
U"^o I ail and b^ | ao that 



=0 



n: 



=0 



n: 



nto nr=fc+i = IJ Ib^l = |ao/bfc| U IJ |ai 



afc(ao/bfc)|u |J |ai| = afc(ao/bfc) HLi IliLfe+i 



Restricting the partial order Q from the order n abstract index expression to 
the labels available in the order 1 and n — 1 subexpressions produces partial 
orders which will serve for these, so they satisfy all the conditions. □ 
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Once existence has been established, the next step is to estabhsh some 
elementary results on how the abstract index notation compares to ordinary 
notation. This is the subject of the next three theorems. 

Theorem 4.3. For all lists a and b such that |a| and |b| are disjoint sets, 
and all-i E V{\\sl\\ , \\h\\) , 

0(|H)= (4.5) 

7 = E I 7^] . (4.6) 

Proof. The first identity is straight off from the definition. In the second 
identity, any partial order which has every element of |a| less than every 
element of |b| fulfills the acyclicity condition, so the right hand side exists. 
Computing its value using rule [2] yields 

ci7S] = e^/^Ni]o7®[:;:ii]oR./.)ii] = 

= I 1] o 7 ® 0(1°) o g I 1] = o 7 o (lll^'ll) = 7 

since a/a is the empty list. □ 
Lemma 4.4. For all a, b, and c such that |a| = |b| = |c|, 

E|l]°[b|l] = £|l]- (4.7) 

Proof. Let ai ■ ■ ■ Om = a, 6i ■ ■ ■ 6^ = b, and ci ■ ■ ■ Cm = c. Let a,T E be 
such that bi = a^^i) and q = hr{i) for i = 1, . . . , m. Then q = ^^-(j) = a„{r{i)) 
and thus 

I 1] = 0^(ar) = 0^(a) o 0^(r) = | l] o | l] . 

□ 

Lemma 4.5. For all a, b, c, and d such that |a| = |b| and |c| = |d|, 

[ac|l] = [a|l]®[c|l]- (4.8) 

Proof. Let ai ■ ■ ■ = a and Ci ■ ■ ■ q = c. Let a G and r G S/ be such 
that b = ao-(i) ■ ■ ■ ao-(fc) and d = Cr(i) ■ ■ ■ Cr{i)- Define 

tti if i ^ k, ^ _ |a^(j) if z ^ /c, 

Ci-k otherwise, lcT-(j_fe) otherwise. 

Then ac = ci ■ ■ ■ Ck+i, bd = /i ■ ■ ■ f^+i, and fi = e^a^r){i) for all i. Thus 

[l^ I 1] = <t>k+iicx * r) = M^) ® Mr) = [a I 1] ® [c I 1] • 

□ 
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Lemma 4.6. Whenever |c| = |bo|, 

nr=i(7.)^;l o 1 1] 



nLi(7.)^: 



(4.9) 



Proof. By induction on the order n. If n = then this is the claim of 
Lemma 14.41 If n = 1 then 



& I o [I I 1] = 

= Eo^^"/^^^ 1 1] ® c:;^: 1 1] o [i,^,,,,, \ i] = ^ \ (70^^]- 

Finally if n > 1 and assuming it holds for expressions of order n — 1, then 



nr=i(7.)^: °[bo|i] 



afc(ao/bfc) 



afc(ao/bfc) 
ao 



afc 

(7.) 



bo 

afc(ao/bfc) 



nt^(7.)^:nL.+i(7.)^; o[Co|i] 



afe 



afc(ao/bfe) 



nt^(7.)^nL.+i(7.)^: 

nLi(7.)^; 



where A; ^ 1 is minimal such that b^, | Hq. 



□ 



The analogous identity for left action of permutations also holds, but is 
a bit more technical as there formally is a greater dependency on the order 
of output labels. 



Lemma 4.7. Whenever IcI 



1^0 I) 



[c' I 1] 



nr=i(7.) 



nr=i(7.) 



(4.10) 



Proof. Again by induction on the order n. If n = then this is the claim of 
Lemma 14. 4[ If n = 1 then by Lemmas 14.41 and 14. 5[ 

I 1] o & I (7i)S ] = 

= [:ii]oK^-/^^)|i]o7.®K:ii]o[^o^^^^^^^^ 
= f(-/^^)|i]o7,®K:ii]o[^^o^^^^^^^ 



1 1] o 1 1] ^ 1 1] o 7, ® t:;^: 1 1] o [jo^^^^^^^ 1 1] 



ao/bi 



47 



|-bi(c/bi 
|-bi(c/bi 
|^bi(c/bi 
|^bi{c/bi 
|^bi(c/bi 



i]°([S|i]°7>([:;cmi]°K:ii])°e:(.o/mU] 

1] ° (71 ° en 1]) ® (K: 1 1] ° KM 1]) ° &ao/bj ^ 

i]°7i®[e;b:ii]°fiHi]®GCMi]°C:Wbji] = 
i]°7i®K:ii]o[::|:;C;'ii]o[^^^^^^^^^^^^ 

i]°7i®K:ii]o[j'(,/,ji] = p>i(7oa- 



If n ^ 2 then assume the lemma holds for all expressions of order less 
than n. Let k be minimal such that | Hq, let A = ni=i^(7«)a* 
5 = nr=m(7.)^:- Then 



[T 1 1] ° E: I A{j,)iiB] = 1 1] o [ 



afe(ao/b()) 



(7.)^:] O E(ao/bo) I 



_ rafc(ao/bo) I (^,\^k~\ q [bo I 4 0] _ 

- Lc I I7fcjaj ° Lafc(ao/bo) I ^^J " 

= [-^^/^"^ I (7.)^:] O CjXf I 1] ° E(ao/b„) I = 

= S'^^^/"''^ I (7.)^] ° E(e/bo) I = [c" I Mlk)tB] 

where the second last step uses the induction hypothesis and the last step is 
by definition. □ 

That composition of two abstract index expressions is a kind of concate- 
nation happens not only when one of the subexpressions is of order 0, but 
also in general. 



Theorem 4.8. // bo = Cq and 







nr=i(A) 



nLi(7.)^ 



n 



n 



n 

i=0 



I bo I then 



KLiimK=i(rfdc: ■ (4.11) 



Proof. If m = or = then this is just Lemma 14.71 or 14.61 respectively. 
Hence it can be assumed that m, n ^ 1. 
Let eo = ao, and recursively define 

ki = mm(j^ k e {l,...,m} (b^ | ei_i) | \ {ki, . . .,ki_i}^, 
for i = 1, . . . ,m. Then by definition 



ao 



= [II I (/3^j':m ° ■ ■ ■ ° C:-. i (/^^Jfc] • 
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Let Qi and Q2 be the partial orders on labels in the two abstract index 
expressions in the left hand side of (14. lip . Let Vi = IJI^i l^il' ^ = Ur=i 
and Vo = |bo|. Define a partial order Q on Vq U Vi U V2 by having x ixiQ 
iff 



1. X, y G Vi and a; ^ ?/ in Qi, or 

2. X, y G Vo and x = y, or 

3. x,y E V2 and x ^ y in Q2, or 

4. X eVi and ?/ G U V2, or 

5. X G Vo and ?/ G V2. 

This partial order fulfills the acyclicity condition for the right hand side of 
(14. lip , and so it is clear that that exists. Since m + n ^ 2, repeated use of 
rule [3] of Definition 14.11 on this right hand side yields 



nr=i(A)^:nr=i(7.)^ 
= K I (/3.ja:^] o . . . o [-_^ I o h nr=i(7.)^/ 



n::i(A)^; 
nr=i(A)^;l ° fc 1 1] 



do 



nLi(7.)^ 



do 



nLi(7.)^ 



n:Li(7.)^ 



where Lemmas 14.61 and 14.71 are used to adjust the order of labels at the 
composition to match bo = Co. □ 



Lemma 4.9. // 



nr^ob. 



and |c| are disjoint then 



boc 
aoc 



n:Li(7.)^; 



(4.12) 



Proof. This is proved through another induction on order. If = then this 
is a special case of Lemma 14.51 If = 1 then by direct calculation, 



[S I (7l)a\1 ® [c I 1] = 

= 1 1] 07,^ [-/^; 1 1] o 1 1]) « ([^ 1 1] o 1 1] o 1 1] 

= K^'^'^/^^^ 1 1] ® [c 1 1] o 71 ® c;^: 1 1] ® [c 1 1] o £Vo/bo 1 1] ® [c 1 1] 
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bi(ao/bi)c 
aoc 



ai(ao/bi)c 



1] 



_ rbi(aoc/bi) I il ^ ra(,c/bi I -, 1 rboc I 1 _ fboc I / Nbi] 

Finally, if n ^ 2, A; ^ 1 is minimal such that | ag, and assuming fl4.12p 
holds for expressions of order n— 1, let A = 11^=1^ (7«)ai B = YYi=k+ii'yi)a.t ■ 
Then 



& I ^(7.)^-^] ® [c I 1] = 

= (fe^^°/'^^|(7.)^:]°E 



(ao/bfc) 



^^])®([c|l]°[c|l] 



I (7fc)^:] ® 1 1] o [ii 

_ rafe(ao/bfc)c I / \bfel rboc 
— Laoc I I IkJaiki I 



afc(ao/bfe) 

c I 

,afe(ao/bfc)c I 



I ^B] ® [I I 1] = 



□ 



Theorem 4.10. // 



n 



m 1 

^=0 bi 



and 



n- 



:0 



bodo 
aoco 



are disjoint then 

nr=i(A)^;nr=i(7.)^;l. (4.13) 



nLi(7.)^ 

Proof. First, the special case that m = and ao = bo; this is complementary 
to Lemma [4. 9[ and uses it to eliminate the tensor product: 



K 1 1] 



nr=i(7.) 



Ko 1 1] ° K 1 1] ° [z 1 1] 



nLi(7.)^ 



_ fcobo I 1 1 
~ Lboco I -^J 

Lboco I -^J 



do bo 
Co bo 



IYL,hi}t:\ ® K: 1 1] o 1 1] 

n:Li(7.)^ o [ss 1 1] 



bodo 
bo Co 



n:Li(7.); 



The general case is proved using Theorem 14. 81 and the two special cases where 
one factor is an identity. 



n:Li(7.)^ 



Ei(A)^;loK:|i] U^ [c^|i] 



utM)i:\ ® [z 1 1] ° K 1 1] 



bo Co 
aoco 



bodo 
bo Co 



bodo 
aoco 



□ 
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The final thing about the abstract index notation that needs to be un- 
covered is that some details in it are irrelevant, namely the choice of labels 
and the order of factors. The first of these is mostly an observation. 



Theorem 4.11. For every injection f on the set of labels, 



/(bo) 
/(ao) 



nr=i(7, 



N/(b.) 



(4.14) 



where f is extended to lists of labels by acting on each element separately, 
I.e., f{ai---am) := /(ai) ■ ■ ■ /(a™). 



Proof. No part of Definition 14.11 depends on the value of individual labels, 
only on in which positions there are equal labels. This is preserved by injec- 
tions. □ 

The next lemma generalises rule |3] of Definition 14.11 in several ways: it 
covers also expressions of order 1, it allows an arbitrary order for the list c of 
intermediate labels, and most importantly it ignores the order of the labelled 
factors. 

Lemma 4.12. Ifn ^ 1, I ^ 1 is such that hi \ slq, and |c| = |a;(ao/bi)| then 



nr=i(7.)^: =[:ol(70^;]° c" n:=l(7.)^:nr=Hi(7.)^: 



(4.15) 



Proof. If n = 1 then this is just the claim of Lemma 14.61 For n = 2 and 
/ = 1 this is a special case of Theorem 14. 8[ For n = 2 and / = 2 there 
are two possibilities. Either bi \ slq and then by definition. Lemma 14. 6^ and 
Lemma 14.71 

K I (7l)a\H72)£] = [af "/^^^ I (72)£] O | (71)^] = 



ra2(ao/b2) 
Lao 



(72)£] o [I, 



a.(ao/b.) I 1] O [-(-/^^) I 1] O I (7,)^ ] = 

= [:oi(72)a°[ci(7i)a. 



Otherwise bi | slq, where the definition instead puts 71 in the left operand. 
Let d = ao/babi. By Theorems and EHl 



K I (7i)S(72)£] = [If"' I 1] ° [Sbld I Mi] ° I (72)£] o I 1] 

= K'^' I 1] ° ill I 1] ® K I (71)^,^] O £ I (72)£] ® £^ I 1] O [^«,^, I 1] : 



[T'' I 1] ° ( I 1] ° [b^ I il^m ) ® ( K I (7l)a\^] O [lit I 1] ) O I 1] 

[T'" I 1] ° ( ill I (72)^.1 o I 1] ) ^ ( [-1^, I 1] o [If, I (70^;] ) o fc^, I 1] 
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Cf I IJ o [Z 
^ rb2bid 
Lao 



1] ° E I (72)aM ® I 1] 



ra2 



[bo 



1] 



ra2bid 
Lb2bid 



(72 



° La2 I 1] ® Kd I (7l)^^] O La,.,d 

"1 ° C^bld I (7i)^!] o I 1] = 

\b2 
)a2 



1] 



[bo 
Lao 



(7 



a2j La2bid 

)£(7i^' 



Lao 



(72)aop'|(7it^]. 



For n > 2 this is again by induction, so assume fl4.15p holds for all expres- 
sions of order less than n. If / is minimal with respect to the condition b; | ao 
then proving (I4.15P is just a matter of using the definition and then permut- 
ing the intermediate labels, like above. Otherwise let A; ^ 1 be minimal such 
that b, I ao, let A = nl"/(7.)^:, let B = ntl+i(7.)^;, let C = nr=.+i(7.)^:, 
and let d = akM^o/hkhi). Then nr=i(7i)a: = ^(7fc)^,^5(7z)^;C and 



n:Li(7.)^; 



I (7.)S1 ° £(ao/b.) I m^m = 

= fc^^"/^^^ I (7.)^] ° [l(ao/b.) I (70M o I ABC] = 

= Gol(7.&(70MoGiA5c] = 

= [:„ I (7.)S] o E I (7.)^:] o go I ABC] = 
= t I (70S] ° [c" I Ml^t^BC] 

where the first step is by definition and all others are by the induction hy- 
pothesis. □ 



Theorem 4.13. For every permutation a G S„, 



nLi(7.)S 



nr=i(7<x(i)) 



3<T(i) 
l<T(i) 



(4.16) 



In other words, the abstract index notation does not care about the order of 
factors in the product part. 



Proof. The only part of Definition 14.11 which depends on the order of the 
labelled factors is the minimality of k in rule [3], but Lemma 14.121 states that 
(14.41) holds regardless of the minimality of k, hence the order of the factors 
is irrelevant. □ 



4.2 Derivatives 

One thing that becomes a lot simpler to state using abstract index notation 
is the definition of a derivative on a PROP. 

Definition 4.14. Let V be an 7?,-linear PROP. An (outer) derivative D on 
V and a gradient V on P are degree (0, 1) and (1,0) respectively 7?.-linear 
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maps V — )■ V which satisfy the respective product rules 

^(k I = cr I + Er I pt,Dii)iic]: 

where c ^ |aoaia2| = |bobib2|. 



(4.17a) 
(4.17b) 



If V is some PROP of fields on a manifold (for example that of Exam- 
ple ETTJ]), then the (0,0) component is the scalar fields (ordinary functions), 
the (1, 0) component is the vector fields, and the (0, 1) component is covec- 
tors (1-forms). Hence it is natural to call a degree (0, 1) derivation an outer 
derivative and a degree (1,0) derivation a gradient. 

For a pure composition or tensor product, the product rule amounts to 

D{f3 o 7) = D{f3) o 7 ® 0(|i) + (3 o ^(7), 
D{(3 ® 7) = D{/3) 7 o 0(r(« * -WX^) + /3 ® Z}(7). 



From the former it follows that 

D{<p{n) = D{<p{n o 0(1")) = D{<p{n) o ^(n ® 

= z}(0(n)o0(r+i)- 

and thus D(0(l")) = 0. Moreover, 

d(</>(^x1)) = d([: 



a\a2 
b2bi 



aia2C 
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l\b2 
)a2 



+ 



a\a2C 
b2bi 



(|i) + 0(r)oD(0(n): 
D(0(r)) =2Z}(0(r)) 



<P{\') ^D{<f){\')) o 0(1X1 * |i) + 0(1X1) o 0(|i) ® Z}(0(|i)) 



:|i)®Oo0(iXi^|i) + 



^ivl 



Oo 



fiXi*|i) + 0(1X1) oO 



Xi)o0(|i)®O 
+ = 0. 



As all permutations can be built up from |i and iXi, it follows that all 
permutations have as derivative. 

An even nicer way of denoting derivatives, particularly in naked abstract 
index expressions, is to treat the derivative itself as a "tensorial operator" 
which takes one abstract index. Then the equivalents of (14.171) becomes 



= V^(/3a^^)7a^^ + /3a^^ V^(7 



a2 



(4.18a) 
(4.18b) 
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Note, however, that such "abstract index notation with operators" is not 
covered by Definition 14.11 The natural extension that could be made to 
cover these would be that a subexpression 



where Hq := (nr=i ^i) / (IlLi ^0 ^nd similarly bo := (HLi ^i) / {IT^=i ^i)- 



Where there is a standard coordinate system, and dc are often used 
for the gradient and outer derivative respectively with respect to these coor- 
dinates. Leibniz-style partial derivative operators like ^ are also common, 
but note that sub- and superscripts by convention switch position in the de- 
numerator: ^ = has degree (1,0) and ^ = t^i has degree (0,1)! This 
is apparently so that one can have ^ = ~ ff^; which is desirable in the 
coordinate interpretation of the notation. (Due to general rules about raising 
and lowering indices, x° and be quite different numerically, even if 

they sort-of encode the same information, so the partial derivative of Xa with 
respect to x'' need not be 1 for a = 6 and for a 7^ 6.) 

Yet another commonly occurring notation for derivation is that a punc- 
tuation mark in an abstract index sub- or superscript, like for example in 
'9ah,c\ signals that subsequent indices are ones that were added to the root 
symbol by some derivative. Different punctuation marks correspond to dif- 
ferent derivatives, e.g. a comma may signal the standard derivative, whereas 
a semicolon may signal some alternative derivative. In Riemannian geometry, 
it is common that the comma means "partial derivative" (i.e., partial deriva- 
tive with respect to the local coordinate system obtained from the current 
chart), whereas semicolon means "covariant derivative" (i.e., the globally 
defined derivative that sees the inner product as being constant). 

Lemma 4.15. Let TZ he an associateive and commutative unital ring. Let V 
he an TZ-linear PROP. Let 





he a well-formed ahstract index expression. Then 



n 



(7i,---,7n)^ s n^^^ft 



:^(l|bi||,||ai||) 



X ■■■ xP(||b„||,||a, 



■71 



II) ^fOKIMIbo 



II) 



is an TZ-multilinear map. 
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Proof. In an 7^-linear PROP, the o and ® operations are 7^-bilinear. Hence 
in the case n = 1, the 7?.-hnearity of the abstract index expression follows 
immediately from the definition (item |2] of Definition 14. ip . For n > 1, item|3] 
of Definition 14.11 defines the value of the abstract index expression as a com- 
position of n order 1 abstract index expressions, each of which by the above 
depends 7^-linearly on one factor. Hence the map as a whole is 7^-multilinear, 
as claimed. □ 



5 Network notation 

The abstract index notation improves upon the categorical notation in that it 
imposes less irrelevant structure upon the expression, but it is still obscure in 
that the very relevant structure of how separate factors fit together requires 
an effort to discern. The network notation is more spacious, but shows clearly 
the relations between factors and also makes it easy to spot larger subexpres- 
sions within a given expression. The downside of it is that it is graphical, 
spreading out in the plane rather than basically sticking to a baseline as text 
and mathematical formulae are mostly supposed to do. That PROPs should 
be allowed such notational liberties when most of mathematics is perfectly 
well served by horizontal notation with only the occasional index, exponent, 
numerator, or denominator escaping from the baseline is perhaps not ob- 
vious, but a partial explanation is that PROPs have both composition and 
tensor product; it is natural to orient these along separate axes. Nor is the 
issue without precedence; just like the notational inventions of abstract index 
notation were present already in the more specialised Einstein notation, so 
are the basic elements of the network notation present in e.g. Penrose graphi- 
cal notation [I2j and Majid's 'shorthand diagrams' [TU]. §tefanescu [15^ p. 8] 
attributes the term 'network algebra' to Jan Bergstra (1994). 

5.1 Formal definition and basic properties 

Concretely, a network notation expression looks a lot like an electrical curcuit 
diagram, with "wires" connecting various "gates" and additional wires go- 
ing to external connectors. Figure [2] shows some styles in which the network 
expression equivalent of [^^ | /x^^/igjA^'^A^^] might be drawn, but for those 
who have not seen it already, it's probably just as informative to get on with 
the formalia. 

^ Or instead of 'gates' more commonly 'components', but that word would risk confusion 
with the 'PROP component' concept. 
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Definition 5.1. A network of an N^-graded set V is a, tuple 



G={V,E,h,g,t,s,D) 



(5.1) 



where 



• V is a, finite set, called the set of vertices. V 3 0,1, where is called the 
output vertex and 1 is called the input vertex. Elements of y \ {0, 1} 
are called inner vertices. 

• E is a finite set, called the set of edges. 

• h: E — y V is called the head map. t: E — V V \ {0} is called 
the tail map. Define the input d^{v) and output d^{v) valencies of a 
vertex v by 



An output leg of G is an e G with h{e) = 0, and an input leg of 
G is an e e ii^ with t{e) = 1. A leg in general is an edge which is an 
input or output leg. A stray edge of a network is an edge which is both 
an input and an output leg. 



• D: V \{0,1} — > V is called the annotation. 
and these satisfy 

1. The tuple {V,E,h,t) is a directed acyclic graph, i.e., there is no se- 
quence ei, . . . ,en & E such that h{ei) = i(ej+i) for i = 1, . . . , n — 1 and 
h{en) = t{ei). 

2. Head and head index uniquely identifies an edge, as does the combi- 
nation of tail and tail index; if 61,62 G E satisfy h{ei) — h{e2) and 
g{ei) = g{e2) then ci = 62; similarly if 61,62 G E satisfy t{ei) — ^(62) 
and s(6i) = •5(62) then 61 = 62. 

3. Head indices are assigned from 1 and up; if 61 e is such that g{ei) > 1 
then there exists some 62 E E such that h{e2) = h{ei) and (7(62) = 
g{ei) — 1. Similarly tail indices are assigned from 1 and up; ii Ci & E 
is such that s(ei) > 1 then there exists some 62 & E such that ^(62) = 
t{ei) and 5(62) = -s(ei) — 1. 



d-{v)^ {eeE\h{e) 
d+(v) = {eeE\ t{e) 



g,s: E 



Z. 



-+ are called the head index and tail index maps. 



56 



4. Arities and coarities of the annotations agree with the in- valencies and 
out-valencies respectively of the inner vertices; d~{v) = a(^D{v)^ and 
= uj{D{v)) for every v eV\{0, 1}. 

The arity a{G) is defined to be the valency d'^{l) of the input vertex 1 and 
coarity U!{G) is defined to be the valency d~{0) of the output vertex 0. Denote 
by Nw(P) the N^-graded set of all networks of V which have V, C N. 

In short, networks are graphs with some extra structure!! so it is only 
natural that one might prefer to draw them. The thing about them that is 
most uncommon for a graph is probably the head and tail index maps — that 
it matters which point on a vertex that an edge is attached to — but this is 
essential for their role as alternative presentations of the information in an 
abstract index expression. 

One thing that one must watch out for when reading expressions in net- 
work notation is that different authors follow quite different conventions re- 
garding what sides represents 'in' and 'out'. §tefanescu [I5j, Majid [10], 
Lafont [S] , Baez-Stay [T] , and I appear to prefer diagrams drawn with edges 
oriented from top to bottom, whereas for example Penrose [T2] and Markl- 
Voronov [11] rather prefer them oriented from bottom to top. Since many 
important theories have a large degree of symmetry between input and out- 
put, one can at times get rather far into an argument before realising that 
the notation is the opposite of what one expected it to be! There is of course 
also the possibility of making edges horizontal rather than vertical, but then 
there is equally much the ambiguity of whether to go left-to-right [H |3] (as in 
the common reading direction of Western languages) or right-to-left [1] (as 
in the common direction for composition of mathematical functions). There 
does not seem to be a convention that is singularly more natural than any 
other, so a certain amount of mental gymnastics will probably always be 
required when translating from one notation to another. 

Definition 5.2. Let a network G = {V, E, h, g,t, s, D) be given. For every 
V E V, define e'^{v) and e'^{v) by 

e^(t>) = ei . . . ed+(v) where t(ei) = v and s(ej) = z for all i = 1, . . . , d'^{v), 
e^(f ) = ei . . . ed-{v) where h{ei) = v and g{ei) = i for alH = 1, . . . , d~{v). 

If G is a network of a PROP V then the value of G is 



eval(G') : = 



4(1) 

Bg(0) 



n ^(«):|:! 

t;ey\{o,i} 



(5.2) 



^ And in case anyone wonders, this is not the same extra structure as one adds when 
one studies flows in graphs, even though those graphs are called 'networks' too. 
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1 2 




1 2 

(a) Elaborate style (b) Pragmatic style (c) Bialgebra style 

The above are three different styles for the network expression equivalent of 
[aft I l^cdl^ef^T^'h] ' '^^^ elaborate style explicitly puts all information in the pic- 
ture, but it is too cumbersome for pretty nuich everything besides explaining the 
notation. The vertex ('2: ', '3: ', etc.) and edge (a, b, c, etc.) labels arc typically 
omitted when one depicts the isomorphism class of a network, but may help to 
show the correspondence with the abstract index expression. 

The pragmatic style drops the edge orientations (arrowheads) and indices, since 
these can anyway be determined from the picture if one sticks to certain conven- 
tions for how it is drawn. First, edges are always oriented downwards, with heads 
against the top side of a vertex and tails against the bottom side of a vertex. Sec- 
ond, at each vertex the head/tail index increases from left to right, so the leftmost 
input and output are always those which have index 1, and the rightmost arc al- 
ways those whose index equals the (co)arity of the vertex annotation. Thus only 
the annotation remains in the vertex. 

The bialgebra style is, like the Penrose graphical notation, an example of a 
further streamlining of the notation to suite a particular problem domain by eliding 
also the vertex annotation, while leaving visual clues to this in the shape of the 
vertex. In this style. A, ji, e, and r] vertices are all drawn as circles (which are 
quicker to draw by hand than squares), and one can tell from the number of inputs 
and outputs which of the four types is at hand; inputs are on the top half of the 
circle, outputs are on the bottom half. 

Figure 2: Three styles for network drawing 
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If P is a PROP, G is a network of an N^-graded set Q, and / : Q — > V is an 
N^-graded set morphism then similarly define the /-value of G as 



eval/(G') := 



4(1) 



veV\{Q,l} 



(5.3) 



The next step is of course to prove that eval is well-defined, but there is 
another concept which should be defined first. 

Definition 5.3. Two networks 

G = {V,E,h,g,t,s,D) and H = {V , E' ,h' , g' ,t' , s' , D') 

are said to be isomorphic, symbolically G ^ iJ, if there exists bijections 
X '■ V — y V and : E — > E' such that 

h'o'ijj = xoh, g'o'ijj = g, xiO) = 0, 

t'o^ = Xot, s'o'ijj = s, = 1, 

D'ox = D. 

Denote by Nw(f2) the set of isomorphism classes of Nw(f2). 

It may be observed that the pragmatic and bialgebra styles of Figure [2] 
depicts network isomorphism classes rather than specific networks in those 
classes. This is completely analogous to graph drawing, where one frequently 
depicts graphs without explicitly labelling vertices or edges. 

Theorem 5.4. Let V be a PROP and G a network of V. Then eval(G) 
is well- defined. If H is a network of Q and /: Q — > V is an N'^-graded 
set morphism, then evalf{H) is well-defined as well. Moreover any network 
G' c:^ G has eval(G') = eval(G) and any network H' c:^ H has evalf{H') = 
evalf{H). Hence eval is a map Nw{V) — > V and evalj is a map Nw(f2) — v 
V. 

Proof. First observe that the Gq{v) and Gq{v) notations are well-defined for 
all networks; axiom [3] implies that the necessary Cj exist and axiom [2] implies 
that they are unique. Axiom H] then ensures that the arity condition of the 
abstract index expressions (15.21) and (15. 3p are fulfilled, and the matching 
condition holds because h, t, g, and s are all maps. Finally, axiom [1] ensures 
the acyclicity condition is fulfilled. A further point of ambiguity could be 
that the order of factors in (15. 2p and (15.31) is unspecified, but Theorem 14.131 
has already established that this is irrelevant for the value of an abstract 
index expression. 
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In order to see that eval and eval f does not distinguish between isomorphic 
networks, one may first observe that the vertex labels do not occur directly 
in the abstract index expressions defining these; for inner vertices only the 
annotations matter, and these are preserved by isomorphisms, the 
vertex labels and 1. Second, changing edge labels has by Theorem 14. Ill no 
effect on the value of an abstract index expression. This covers everything a 
network isomorphism can change. □ 

This correspondence between networks and abstract index expressions can 
also be carried in the opposite direction, to establish a text-like notation for 
networks. This is primarily useful when reasoning about families of networks 
on a particular form, as will be done in some proofs below. 

Definition 5.5. Let V be an N^-graded set. Let ag, . . . , a„ and bg, . . . , b„ 



be lists such that E 
P(||b,;||,||a,,|h for 2 = 



. , n and let Vi 



is a set and 



n: 



E. Let 7i e 



be distinct labels such that 



0,1^ {f 1, . . . , f „}. If there exists a partial order P on E such that x < y in P 
for every a; G |bj|, ?/ G |aj|, and i = 1, . . . ,n, then what is denoted by 



Nw 



is the network G = ({0, 1, vi, 



6^(0) 



ao 
a 



■4) 



nr=iK:7.)^;) (5.4) 

, Vn}, E, h, g, t, s, of V such that 



D(v,) 



bo, 
b. 

7i 



for all i E [n], 
for all i G \n\. 



In the special case that Vi 
simplified to 



i + 1 for all i G [n], this notation may be 



Nw(- 



nr=i(7i 



(5.5) 



(that is: when no explicit vertex labelling is given, then assign labels left to 
right in the product). 

Clearly, the equations for define h and g on all of E, whereas the 
equations for similarly define t and s; these are well-defined since each 
edge label occurs once in HiLo^* once in IliLo'^i- Network axiom [1] 
follows from the existence of the partial order P, axioms [2] and |3] follow from 
the definitions of and e^, and the 7^ were explicitly chosen so that axiom H] 
would be fulfilled. 
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Corollary 5.6. Let V be a PROP. Let m and n be lists of labels such that |m| 
and |n| are disjoint sets. Let 7 G ^(llmll , ||n||) and v ^ {0, 1} be arbitrary. 
Then 

(/)(|HI)= eval(Nw(:^|l)), (5.6) 

7= eval(Nw(:;|(t;:7)n))- (5-7) 

Proof. This is just as much a corollary of Theorem 15.41 — on the point that 
eval is well-defined — as of Theorem 14. 3[ on the point that it gives the values 
for exactly those abstract index expressions as which the right hand sides are 
defined. □ 

More examples of this abstract index notation for networks and their cor- 
responding diagrams can be found in Figure [31 In those cases the abstract 
index notation is convenient because it formally allows one to leave the num- 
ber of edges connecting two vertices unspecified; with an explicit diagram, it 
is more a matter of drawing some illustrative number of edges and using the 
head and tail index labels to suggest that they may vary. 

Next up, the network counterparts of Theorems 14.81 and 14.101 This re- 
quires two new concepts. 

Definition 5.7. A cut in a network G = (V, E, h, g, t, s, D) is a bipartition 
WoUWi of V\ {0, 1} such that no e e E satisfies h{e) e Wi and t(e) G Wq. 
The cut is said to be non-trivial if Wq and Wi are both nonempty. An 
edge e G -E is said to be a cut edge if h{e) eWoU {0} and t{e) eWiU {1}. 
Let Ec be the set of all cut edges. The cut is said to be above X C Wq if 
X = p{h){Ec), and conversely below X CWi if X = p{t){Ec). 

A cut is said to be ordered if it is given as {Wq, Wi,p) where p: Ec — > 
[\Ec\\ is a bijection. The decomposition of G induced by the ordered cut 
{Wo,Wi,p) is {G',G"), where 

G' = {V, E', h', g', t', s', D') and G" = {V", E", h", g", t", s", D") 

are defined by 

V' = WqU {0, 1} V" = WiU {0, 1} 

E' = {eeE\ h{e) G U {0} } E" = {eeE\ t{e) eWiU {1} } 



h' = h\E' t" = t 



E" 



t{e) otherwise, I h{e) otherwise. 
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.'(e) 
D' 



p{e) if e G Ec, 
s{e) otherwise, 



/(e) 



D" 



p{e) if e e Ec, 
g{e) otherwise, 

D\wi- 



An ordered cut (Wq, Wi,p) is said to be obvious ii p = g\E^ = s\e^- It is said 
to be obvious above (t>i, . . . , Vk) if (i) it is above {f i, . . . , Vk}, (ii) h{ei) = Vi, 
h{e2) = Vj, and i < j for some ei,e2 G E^ imphes p(ei) < p{e2), and 
(iii) h{ei) = h{e2) and g{ei) < g{e2) for some ei,e2 G Ec imphes p(ei) < 
p(e2). Analogously, {Wo,Wi,p) is obvious below {vi,...,Vk) if (i) it is 



below {fi, . . . (n) t(ei) = fi, t(e2) 
implies p(ei) < p(e2), and (in) t(ei) 
ei, e2 e -Ec implies p{ei) < p{e2). 



■ Vj, and i < j for some ei, e2 G -Ec 
t(e2) and s(ei) < s(e2) for some 



Lemma 5.8. Let V be a PROP and G be a network of V . If {G',G") is a 
decomposition of G induced by some ordered cut {Wo,Wi,p) then eval(G) = 
eval(G') oeval(G"). 

More generally, if V is a PROP, is some N'^-graded set, f : n — > V 
is an N'^-graded set morphism, G a network of Q, and {G',G") is a de- 
composition of G induced by some ordered cut {Wq,Wi,p) then evalf{G) = 
eva\f{G')oeva\f{G"). 

Proof. Consider first the claim about eval/. Let k be the number of cut edges, 
and let p = ^-^(1) • ■ -p-^ik). Then e" (0) = e-(0), e+ (1) = p, e^„{0) = p 
and e^„(l) 



Gq{1). Hence by Theorem 



eval/ (G") o eval/ (G") 



p 



veWo 

e5(0) 



{v) 



4(1) 

P 



n /(^(^)) 



v€Wi 



v€Wo 



veWi 



eval/(G). 



The claim about eval is obtained by taking Q = V and / being the identity 
map. □ 

A special, but frequently useful, kind of cut to make in a network is to 
cut below 1 or above 0, but in a non-obvious order to factor out a particular 
permutation. Conversely, it is natural to define actions of permutations on 
networks as permuting the legs. 
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Definition 5.9. Let G = {V, E, h, g,t, s, D) be a network with m = uj{G) 
and n = a{G). Then the left and right actions of a G and r G S„ 
respectively on G are defined by 

a -G h,g',t,s,D), 
G-r:=iV,E,h,g,t,s',D), 

where 

a{g{e)) if h{e) = 0, 
g{e) if h{e) ^ 0, 

r-i(s(e)) ift(e) = l, 
s(e) if t(e) ^ 1 

for all e G -E. 

It is easily checked that Nw(f2)(m,n) becomes a (S^, S„)-bimodule with 
these actions. In particular {a ■ G) ■ t = (V, E, h, g', t, s', D) = a ■ {G ■ t), so 
parentheses can be dropped in such expressions. 

Lemma 5.10. Let V be a PROP and G be a network ofV. For any permu- 
tations a G S^(G) O'f^^ T G Sa(G) H holds that 

eval((T ■G-t) = (f){a) o eval(G) o 0(r) . (5.8) 

More generally, if V is a PROP, Q is some N'^-graded set, /: Q — > V is an 
N'^-graded set morphism, and G a network of Q, then for any permutations 
o" £ ^w(G) ond r G Sq-(g) it holds that 

eval/((T ■ G ■ r) = (p{a) o eval/(G) o 0(r). (5.9) 

Proof Let (V, h, g, t, s,D) = G and {V, E, h, g', t,s',D) = a - G ■ r. Let 
W = V^\{0,1}, Eo = p{h){{0}), and = p(t) ({!}). Then (0,1^,(7^0) is 
an ordered cut in a -G-t that induces the decomposition {Gq, Gi), where Gi = 
(V, E, h, g, t, s', D) = G-T and Gq = ({0, 1}, Eq, 0, g', 1, g, 0) (where the latter 
and 1 are the constant maps Eq — > {0} and Eq — > {1} respectively). 
{W, 0, s\e-^) is an ordered cut in Gi and similarly induces a decomposition 
{G, Gil) where Gu = ({0, 1}, Ei, 0, s, 1, s', 0). Hence by Lemma ISTSl 

eval/((j ■ G • r) = evalj(Go) ° eval/(G) o evalj(Gii) = 

= (P{g'o (glEo)-') o eval/(G) o 0(s o (s'UJ-^) = 0(a) o eval^G) o 0(r). 

□ 



.'(e) = 
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Definition 5.11. A split in a network G — {V, E,h, g,t, s, D) is a tuple 
{Fi, F,.,W\,Wj.), where FiUF^ is a bipartition of E and l^iUl^^r is a bipartition 
of \ {0, 1}, such that: 

1. if e e Fi then h{e) eWiU {0} and t{e) e Wj U {1}, 

2. if e e F, then h{e) eW,U {0} and t{e) eW,U {!}, 

3. if ei e Fi and Cr G Fr are such that h{ei) — h{er) — then 51(61) < g'(er), 
and 

4. if ei e Fi and Cr G Fr are such that t{e\) — t{er) — 1 then s(ei) < s(er). 

Parts in the bipartitions may be empty. 

Let A; = I {e e Fi I h{e) = }| and / = | { e e Fj | t{e) = 1}|. The de- 
composition of G induced by the spht {Fi, Fr.,W\,Wr) is {G',G"), where 
G' = {V\Fi,h\g',t\s',D') and G" = {V",F,,h",g",t",s",D") are defined 

by 



v 


^WoU {0, 1} 


V" 


= W^i U {0, 1} 




h' 




h" 






t' 




t" 






9' 


= fi'IFl 


9"{e) 


{g{e) - k 
(die) 


if h"{e) = 0, 
otherwise, 


s' 




."(e) 


(sie)-l 
\.(e) 


if t"{e) = 1, 
otherwise, 


D' 




D" 







Lemma 5.12. Let V be a PROP and G be a network of V . If {G', G") is 
a decomposition of G induced by some split (Fi, Fr, Wi, W-^) then eval(G) = 
eval(G") ®eval(G"). 

More generally, let V he a PROP, Vl he an -graded set, G he a net- 
work of ft, and f : ft — >■ V he an W' -graded set morphism. If {G',G") is 
a decomposition of G induced hy some split {Fi, Fj.,Wi,Wr) then eval/(G) = 
eval/(G")0eval/(G'"). 

Proof. For every v e Wi, eQ,{v) — ^^{v) and eQ,{v) — eQ{v); similarly 
eQ„{v) — eQ{v) and ej„(v) = Gq{v) for all v e W^. As for the vertices and 
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1 I 
a 

1 k 



Nw(-|al'6l„C) 



1 n 

6 

1 m 



1 r 
1 s 



1 m 

a 
1 I 



1 fc 
c 

1 r 




1 n 




1 ; 


h 




a 


1 m 




1 fe 



Nw(;;|a-) 



Figure 3: Networks for the proof of Theorem 15.131 

1, e^(0) = e(.,(0)e^„(0) and e+(l) = e+ (l)e+,(l). Hence by Theorem EDI 
eval/(G") ®eval/(G") = 



e+(l) 
e-,(0) 





'e+,{l) 




ec„(0) 



e+,(l)e+,(l) 
e-,(0)e-„(0) 



eval(G). 



Again the claim about eval is obtained by taking Q = V and / being the 
identity map. □ 

5.2 Networks as alternative foundation for PROPs 
Theorem 5.13. Let V he an N^-graded set equipped with 

• an N'^-graded set morphism L : Nw(V) — > V, 

• a partial operation o which for all l,m,n G N maps all of V{1, m) x 
V{m,n) into V{l,n), and 
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• an operation ® which for all k,l,m,n E N maps all ofV{k, I) x V{m, n) 
into V{k + m,l + n) . 

If these are such that 

1. L{G) = L{H) whenever G-H, 

2. L{G) = L{G') o L{G") for every cut decomposition (G", G") ofG, 

3. L{G) = L{G') ® L{G") for every split decomposition {G',G") ofG, 

4. LlNwi^lj^)) =-fforall-feV{\\in\\,\\n\\) 

then V is a PROP with composition tensor product ®, and permutation 
map given by 

0„(cr) = l(({0, 1}, [n], 0, a, 1, T, 0)) (5.10) 

where the latter and 1 denote the constant maps [n] — > {0} and [n] — y {1} 
respectively. 

Proof. Not surprisingly, this is shown by verifying that the axioms are ful- 
filled. The ease by which they derive from the network notation is however 
rather striking. For each axiom, the calculations below use the same vari- 
ables a, 6, c, m, n, r, s, a, and r as in Defintion 12.41 In addition, 
boldface letters k, 1, m, n, r, and s are used to denote arbitrary but pairwise 
disjoint lists of edge labels (thus technically lists of natural numbers in this 
case, since that is how Nw{V) is defined) whose lengths are equal to the 
corresponding normal letter: ||k|| = k, ||1|| = /, etc. 

The composition associativity axiom (a o 6) o c = a o (6 o c) follows from 
considering the two obvious nontrivial cuts in Nw (jj | aj'&m'^™) ^ 

{aob)oc = (^L(Nw{l\a^)^ oL(Nw{^\{3: 6)|„))^ oc = 

= l(Nw(- I a^bl)) o l(Nw(:; I (4: c)-)) = 
= L(Nw(j^|a^6|„C)) = 

= L(Nwa I a^)) o L(Nw(r | (3: 6)^(4: c)™)) = 

= a o (^L(Nw(r I (3: 6)^)) o l(Nw{^ | (4: c)-))^ = a o (6 o c). 

The composition identity axiom follows from considering the two obvious 
trivial cuts in Nw(^|a^). Let m' = Nm(l, 1) and n' = Nn(l,l); these 
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specific lists are needed in this argument because 0„ is defined as the value 
of L for equally specific networks. Then 

a = I a-)) = l(Nw(- | l)) o l(Nw(;^ | a™)) = 

= L(Nw(™;|l))oa = 0^(r)oa 

and 

a = L(Nw(Ji, I a-)) = o l(NwQ | l)) = 

= aoL(Nw(^;;|l)) =ao0„(r). 

The tensor identity axiom similarly follows from considering the two trivial 
splits of the same network. If o is the empty list then 

« = Li^^iZ^ I O) = ^(Nw(° I 1)) ^ L(n^{l. \<))= 0o(l°) ® a, 

a = l(Nw(- I a™)) = ^(Nw(Ji, | a™)) ® l(Nw(° | l)) = a ® 0o(l°). 

By now, it should not be a surprise that the tensor associativity axiom 
follows from considering the two nontrivial splits in Nw(}^'J^r | '^I'b^'^l)^ like 
so: 

(a®6)®c = (^L(^Nw(L|4)) ®L(^Nw(^i,| (3: ®c = 

= i^(Nwfc I a^fc™)) ® l(Nw(^ I (4: c)^)) = 

= L(Nwa I a}')) ® l(nw(- I (3: 6)™(4: c)l)) = 

= a (^l{Nw{^ I (3: 6) IT)) ® ^(Nw(^ | (4: c):))) = 
= a (g) (6(8) c). 

Similarly the composition-tensor compatibility axiom follows from consider- 
ing the nontrivial split and nontrivial cut in Nw (j]^ | alnb^c^dlj , the latter of 
which should be obvious above (2,4) (or obvious below (3,5), which here is 
the same thing) to yield 

(a o 6) (c o d) = (^l(Nw([" I al)) o l(Nw(^ | (3: 6)™))^ 

® {l{Nw{1 I (4: c)9) ol(Nw{1 \ (5: ^^)s))) = 
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= L(Nw(r I alb'^)) I (4: c)^(5: d)l)) = 

= L(Nw(r|(2:a)l„(4:c©) 

°^(Nw(- |(3:6C(5:ci)^)) = 

= (^L(Nw(r I ay) l(Nw(J; I (4: c)|^))) 

o (^(Nw(J;, I (3: 6)™)) ® l(Nw(^ I (5: d)l))^ = 

= (a (g) c) o {b<S)d). 

The permutation composition axiom is again a matter of making the right 
cut in the right network, but here the networks can be given directly in tuple 
form. Letting 

G = ({0, 1}, [n], 0, ar, 1, 1", 0), G" = ({0, 1}, [n], 0, ar, 1, r, 0), 
G" = ({0, 1}, [n], 0, T, 1, r, 0), G"" = ({0, 1}, [n], 0, a, 1, 1", 0) 

one finds that G'" ~ G' and (G', G") is a cut decomposition of G, which 
implies 

</.„((7t) = L(G) = L(G') o L(G") = L(G"') o 0„(r) = o 0„(r). 

Analogously, the permutation juxtaposition axiom is a matter of making the 
right split of the right network. Defining E ~ [m + n] \ [m], g{e) — T(e — m) 
and s(e) — e — m for all e & E, the networks 

G= ({O,l},[m + n],O,(7*T,l,r+",0), G" = ({0, 1}, 0, ^, 1, s, 0), 
G' = ({0, 1}, [m], 0, a, 1, T, 0) , G'" = ({0, 1}, [n], 0, r, 1, T, 0) 

are such that (G', G") is a split decomposition of G and G" ~ G'", from 
which follows 

(/)^+„(a*r) = L(G) = L(GO ® L(G") = L(G'") = ® (/)„(t). 

Finally, the tensor permutation axiom follows primarily from considering 
two trivial cuts in Nw(JjJ,^ | afb^^, namely that which is obvious below (2, 3) 
and that which is obvious above (3,2). In both these cuts, the nonempty 
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part has a nontrivial split, but what is the left part in one split is the right 
part in the other, and that is what the axiom is all about. Let 

G' = ({0, 1}, [k + m], 0, ^X"*, 1, 1'=+'", 0) , 
G"= ({0, !},[/ + r^],O,'X^l,l'+^0) 

so that G' - Nw(J^^ I 1) and G" ~ Nw(Jj| | l). Then 

0(^X™) o (a ® 6) = 

= L{G') o (l(Nw(L I (2: a)\)) \ (3: h)^)) 

= l(Nw(1^^ I 1)) o l(Nw(L'L I (2: a)^(3: b)^)) = 
= ^(Nw(|i^k|(2:a)l'(3:&C)) = 
= ^(Nw(^k I (3: fe)n (2: a)f)) o L(Nw(|il | l)) = 

= (l{Nw{-^\{3: ®l(Nw(L|(2: a)f))^ o L{G") = 

= (6®a)o0fX"), 

which completes the proof. □ 

Theorem 15.131 can be taken as an alternative axiom system for PROPs, 
but it is somewhat awkward in that it refers to the rather technical concepts 
of 'cut' and 'split'. A simpler concept that one can use instead is that of 
"boxing up" a convex subnetwork as a new vertex. 

Definition 5.14. A network H = (Vh, Efj, hn, gH,tH, sh, Dh) is said to 
be a convex subnetwork of the network G = {Vg, Eq, ho, gcytc, sg, Dq), 
written H \Z G, if: 

• Vff C Vg, Eh C Eg, and Dh = Dg\v„\{o,i}- 

• For any e G Eh, hnie) = or {hH,gH){e) = (/^g, 5'G)(e), and similarly 

%(e) = 1 or itH,SH){e) = (tc, SG)(e). 

• There is no sequence ei, . . . , G Eg with n > 1 such that ei, e„ G Eh, 
hniei) = 0, tnicn) = 1, and /iG(ej) = tclei+i) for i e [n - 1]. 

The sense in which the third condition is convexity is that it says no "ray" 
(path) leaving the subnetwork will visit it again. 
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Given G e Nw(P) and H C. G, define the splice map G H by 

{G ^ H){-f) = {V, E', h', g', t', s', D') for any 7 e V{uj{H), a{H)), where 

V 

E' 

D\v) 

{h',g'){3e) 
{h',g'){3e + l) 
{h',g'){3e + 2) 

{t',s'){3e) 
(t',s')(3e + l) 
{t',s'){3e + 2) 

Informally, G H may be thought of as drawing a frame around the 

H part of G, erasing the interior of that frame, and instead putting the 
argument of G H there as decoration of this new vertex. The frame needs 
to be convex for it to be valid as the "shape" of a new vertex. 

Lemma 5.15. Let V be an -graded set. For any convex subnetwork H of 
a network G e Nw(P), 

G^H maps V{uj(H),a(H)) into Nw(V){oj(G),a(G)) . 

Proof. What needs to be proved is mainly that {G -7- H){'y), for every 7 e 
V{io{H),a{H)), fits the definition of a network. Beginning with the anno- 
tation, this fits for a vertex v ^ uq because it is the same as in G. It fits 
for vertex uq because d~{uQ) = a{H) — a{'y) and d'^{uo) = uj{H) — uj{'j). 
Head and tail indices in (G ^ H) (7) are assigned from 1 and up because at 
every vertex of {G -^ H) (7) the head (and tail, respectively) indices are the 
indices at some vertex of G or if (in the latter case those vertices are and 
1). Head and head index uniquely identifies an edge for the same reason, 
and the same is true for tail and tail index. 

What requires H to he a convex subnetwork is the acyclicity condition. 
Seeking a contradition, one may assume Ci, . . . ,en E E' are such that h'{ei) = 
t'(ei+i) for i e [n — 1], that h'{en) = ^'(ei), and that n is the least possible 
for such a sequence of edges. Then these edges cannot all be of the 3e 



1 + max Vc, 

{0,l}U(VG\V^i/)U{Mo}, 

{3e}e(iEG\EH U { 3e + 1 I e e -Eh and /i//(e) = } 
U { 3e + 2 I e e Eh and tnie) = 1 } , 

loYveV \ {0, 1}, 

it f = Mo 

{hG,9G){e) for3eGE', 

{hG,gG){e) for3e + lGE', 

(Mo,SH(e)) for3e + 2e£;', 

{tG,SG){e) ioi3eeE\ 

{uo,gHie)) for3e+lGE', 

{tG,SG){e) ior3e + 2eE'. 
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kind, because that would violate the acyclicity of G. Hence there must be 
edges incident with mq, and it can without loss of generality be assumed 
that h'{en) = uq = t'(ei). There can be no further such edges, because if 
h'{ek) = Uq for some k < n then ei, . . . , is a shorter sequence satisfying 
the same conditions, violating the minimality of n. On the other hand, 
since h'{ei) = Uq implies Cj = 2 (mod 3) and t'(ej) = Uq implies Cj = 1 
(mod 3), it follows that n ^ 2. Hence [ei/3j, . . . , [e„/3j G Eq is a sequence 
of length greater than one such that [ei/3j, [en/3j G Eh, /i//([ei/3j) = 0, 
tH{[en/3\) = 1, and hG{[ei/3\) = tcdei+i/Sj) for i G [n - 1], but this 
violates the last condition for if to be a convex subnetwork. □ 

Definition 5.16. Let V be an N^-graded set. A network evaluation map 

for V is an N^-graded set morphism L : Nw('P) — > V such that 

1. ilG-H then L{G) = L{H), 

2. ifH^G then l(^{G ^ H){L{H))^ = L{G), 

3. L(^Nw(;i, I 7™)) = 7 for all 7 G P(||m|| , ||n||). 

Theorem 5.17. An N'^-graded set V equipped with a network evaluation map 
L is a PROP, with operations defined as 

aob:= L(^Nw(r | a\^b^)^ for a G P(||l|| , ||m||) and b G P(||m|| , ||n||), 

(5.11) 

a ® 6 := I a^b^)^ for a G P(||k|| , ||1||) and b G P(||m|| , ||n||), 

(5.12) 

(j)ia) := l(({0, 1}, [n], 0, a, 1, T, 0)) for a G S„. (5.13) 

Conversely, ifV is a PROP then eval: Nw{V) — > V is a network evaluation 
map. 

Remark. Since many N^-graded sets support several different PROP struc- 
tures, there may also be several different network evaluation maps. 

Proof. That the PROP axioms are, for the most part, implicit in the network 
notation was the main point already of Theorem 15. 13[ so what is needed here 
is primarily a verification that the composition and tensor product defined 
above exhibits the behaviour with respect to cuts and splits that that theorem 
requires. 
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Suppose G is a network and {Gq, Gi) is a decomposition of G induced 
by some cut. Then Gq and Gi are both convex subnetworks of G. Let 
1 = e^„(0), m = e+,(l) = e^^{0), and n = e+^(l). Let H = (G-Go) (L(Go)) 
and uq = maxV//. Let G'l be the network isomorphic to Gi such that the 
isomorphism (x, '?/'): Gi — )■ G'l has x(v) = v for aU v G Vd, ip{e) = 3e for 
e e Eg,\ Ego, and ijj{e) = 3e + 2 for e e Eq, D Eq^. Then G'^ □ H, and 
hence 

L(Go) o L(GO = L(Nw(r | (2: L{G,)f^{Z: L(GO):)) = 
= L(Nw(r| K: L(Go));„K + l: L{G,))Z)) ^ l{{H ^ G\){L{G,))) = 
= L((i/ - G;)(L(G;))) = L{H) = - Go)(L(Go))) = L(G). 

Next suppose G is a network and (Gq, Gi) is a decomposition of G induced 
by some spht. Then Gq and Gi are both convex subnetworks of G. Let k = 
6^^,(0), 1 = e+,(l), m = e^.^(0), and n = e+ (1). Let iJ = (G 4- Go)(i:(Go)) 
and Uq = maxVff. Let G[ be the network isomorphic to Gi such that the 
isomorphism {x,'4') '■ Gi — )■ G[ has x(v) = v for all v e Vq^ and ip{e) = 3e 
for e e Egi- Then G[ □ i?, and hence 

l(Go)®l(go = l(nw(L"„|l(Go)1^l(go™)) =^((^-g;)(l(go^ = 

= L((i/ - G;)(L(G;))) = L{H) = l((G - Go)(L(Go))) = L{G). 

This has shown a network evaluation map gives rise to a PROP structure. 
For the converse, it must be shown that 

eval(^(G if)(eval(i/))) = eval(G) 

whenever H C. G. Let Wq be set set of all vertices in Vq \ {0, 1} that can 
be written as hden) for some Ci, . . . ,e„ G Eq where hciei) = tcicH+i) for 
i e [n-1] and Ci G E^- Let H^q = W^o \ Vh, = Vg\ {0, 1} \ VT^, and 
= \ {0, 1}. Then (l^o U W2, Wi) and {Wq, W2 U l^i) are both cuts in 
G; a back-edge to Wi would contradict the defining property of Wq, and a 
back-edge to W2 would contradict the convexity of H. Let 

Fo= {eeEH\hH{e) = 0}, 
Fi = [eeEnl tnie) = 1 } , 

{eeEG\EH\ hG{e) G U {0},tG(e) G IFi U {1} } ; 
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then Fq U F2 are the cut edges of (14^o, U VFi) and Fi U F2 are the cut 
edges of {Wq U W2, Wi). Let po be an ordering of the former cut such that 
Po(e) ^ I-F2I for e e F2 and po{e) = IF2I + gnie) for e G Fq. Let pi(e) = po{e) 
for e e F2 and pi(e) = IF2I + s//(e) for e G Fi. Then {Wq U Vr2,W^i,j9i) 
is an ordered cut in G, so let (Go, Gi) be the corresponding decomposition. 
Furthermore (Wo,VF2,Po) is an ordered cut in Go, so let (GqojG'oi) be the 
corresponding decomposition of Gq. Then 

eval(G) = eval(Goo) ° eval(Goi) o eval(Gi) = 

= eval(Goo) o 0(11^^1) ® eval{H) o eval(Gi). 

Next let G" = (G ^ //) (eval(//)) and w = maxVb'. Then (Wo U {i^}, M^i) 
and (Wo, {«} U l^i) are cuts in G'; two orderings of these are 



Pi 



Po{3e) = po{e) for e G F2, 

Po(3e + 1) = po{e) for e G Fq, 

p'i(3e) = pi(e) for e G F2, 

p'i(3e + 2) = pi(e) for e G Fi. 



Let (Gq, G'l) be the decomposition of G' induced by {Wq U {u}, Wi,p'-^ and 
let (Gqo,Gqi) be the decomposition of Gq induced by {WQ,{u},p'f^. Then 

G()o ^ Goo and G'^ ~ Gi. Furthermore G'^^ = Nw(^|^;i, (m: eval(//))") for 

some k, m, and n such that ||k|| = IF2I, ||m|| = |Fo|, and ||n|| = |Fi|. Hence 
eval(G()i = ® ev8i\{H) and thus 

eval(^(G H){ev3l{H))^ = eval(Goo) o eval(G[)i) o cval(G;) = 

= eval(Goo) o 0(11^^1) ^ eval{H) o eval(Gi) = eval(G) 

as claimed. □ 

Example 5.18 (Evaluation map in TZ*^*). A practical implementation of 
the evaluation map in some matrix PROP TZ*^* can be to view the edges as 
conduits for messages in the form of row vectors. 

Concretely, to define the evaluation map eval: Nw(7^*^*) — > TZ*^* for a 

network G = {V, E, h, g,t, s, D) of TZ'^', one first constructs an assignment 
A: E — > Jl'^i^) of vectors to edges, according to the following rules: 

• If t(e) = 1 then A(e) is the vector which has a 1 in the s(e)'th position 
and in all other positions, i.e., it is the s(e)'th row in the identity 
matrix with side a{G). 
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If t{e) — V 1 then A(e) is the s(e)'th row of the matrix 



D{v) 



A(ei) 
A(e2) 



where each Cj is the unique edge with /i(ej) = v and g{ei) = i. 



Then 



eval(G') = 



■ A(ei) 
A(e2) 

A(ea;(G); 



where each is the unique edge with h{ei) — and g{ei) = i. 
For example, 



eval 




biia2i bua22 &12 

ciiaii + €12621021 Ciiai2 + 012621022 C12622 

, C2iaii + C22621Q2I C2iai2 + C2262ia22 C22622> 



for A 



m 

A(l) 
A(2). 

"A(4) 
A(3) 

"A(6) 
A(5) 

"A(7) 
A(8) 



On ai2 
O21 O22 



B 



611 612 
621 622 



and C 



Cll C12 

C21 C22 



, because 




1 
1 



021 022 
1 



an ai2 

021 ^22 ' ' 

611021 6iia22 
621021 621022 

On ai2 
621021 621O22 622 

f CllOll + 012621021 Ciiai2 + Ci262ia22 C12622 

VC21011 + C22621021 C21012 + C22621022 C22622 
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Alternatively (and equivalently), one can start from the output side and 
assign column vectors to edges, multiplying each D{v) on the left by the 
matrix built from the outgoing edge messages, and cutting these intermediate 
matrix products up into columns rather than rows. 

Thus having established networks as a notation for PROP expressions 
— arguably, in view of Theorem 15.17^ even as the canonical notation for 
PROP expressions — the next step towards rewriting would be to sort out 
what constitutes a stx^expression. That will however be the subject of Sec- 
tion [TJ since some settings for the answer bring forth technical considerations 
regarding boolean matrices that will turn out to be very important later. As 
the relevant material is not all that well-known, it can be found in the next 
section. 

6 Ordering matrices 

Within optimisation, it is common to regard matrices (and even more so 
vectors) as ordered by element-wise comparisons: A ^ B iS Aij ^ for all 
rows i and columns j . Although this is less commonly seen in other branches 
of mathematics, its use within optimisation alone is important enough to 
earn the title of standard ordering of matrices. Fullbacks of this standard 
ordering is also going to be our main source of nontrivial PROP quasi-orders. 

6.1 Ordered semirings 

Definition 6.1. A partially ordered semiring {TZ,P) is a semiring TZ on 
which is defined a partial order P such that: 

1. if X ^ y in P then x + z^y + z in P for all z 

2. if X ^ y in P then there exists some z ^ in P such that y = x + z; 

3. if x,y ^ in P then xy ^ in P. 

The semipositive cone (sometimes nonnegative cone) in TZ with respect to 
P is the set 

7^^o = {x en\x^Qin P} . 

An X G 7^ is said to be positive if a; ^ in P and multiplication by it 
preserves all strict inequalities, i.e., 

y < z in P =^ xy < xz in P and yx < zx in P. 

The positive cone 7^+ in TZ with respect to P is the set of all positive 
elements of TZ. 
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Obvious examples of partially (totally, even) ordered semirings are the 
subsemirings of R under the standard order, e.g. N, Z, and Q. Another 
elementary semiring that will be of some interest is the Boolean semiring 
B = {0, 1}, which has 'OR' as addition, 'AND' as multiplication, and < 1. 
Composite examples of partially ordered semirings are provided by matrix 
rings and semirings. 

Construction 6.2. Let an associative unital partially ordered semiring (7^, P) 
be given. The standard order on 7^•^• is the Q defined for A,B e 7^'"^" 

by 

A^BinQ <^ Aij ^ Bij in P ioT all i e [m], j E [n]; (6.1) 

matrices of different shapes are unrelated. This is an N^-graded partial order 
which satisfies: 

1. ^ A in Q(m, n) if and only if A e (7^^o)'"''"• 

2. If A,B,C e Te'"^" and ^ ^ 5 in g then A + C^B + C in Q. 

3. If A ^ S in g(m, n) then S = A + C for some C e (7^^o)'"''"■ 

4. If A e (%o)"'"' and B e (7^^o)"'''" then AB e {TZ^oY''''. 

5. The following are equivalent for all A,B,C G TZ*^*: 

(a) Af^B in Q, 

(b) A ® C 5C C in Q, 

(c) C^A^C^B in Q. 

6. If P is well-founded then Q is well-founded. 

Hence (T?."^", Q(n, n)) will be a partially ordered semiring for every n ^ 1. 
Moreover the restriction of Q to (TZ^o)*^' is a PROP partial order. 

Proof. It is clear that Q{m, n) is reflexive. That it is transitive follows from 

A^ B C in Q{m,n) 

<^==^ Aij ^ Bij ^ Cij in P for all G [m] x [n] =^ 
=^ Aij ^ dj in P for all G [m] x [n] «^=^ A ^ C in Q{m, n) 

and that it is antisymmetric from 

A^ B ^ AinQ{m,ri) <(=^ 

<(=^ 74jj ^ ^ Aij in P for all (i, j) G [m] x [n] 

=^ = Bij for all (i, j) G [m] x [n] <(=^ A^ B. 
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This has shown that Q is an N^-graded partial order. 

Claim [T] is immediate from the definitions of Q and TZ^q. Claim [2] (trans- 
lation) is similarly the observation that 

y4 ^ i? in Q{m, n) <^=^ A^j ^ B^j in P for all (z, j) G [m] x [n] =^ 
=^ Aij + Cij ^ Bij + Cij in P for all G [m] x [n] <^=^ 

^ v4 + C ^ P + CinQ(m,n) 

and if A ^ P in Q{m, n) then choosing Cjj G T^^o such that Pjj = Aij + Cjj 
for all G [m] x [n] will produce C ^ in Q such that B = A + C, thus 
verifying claim [3l Claim |5] is equally trivial, as those component comparisons 
iny4(g)C^P(g)CinQ and C<SiA^C<^B in Q that are not those of 
A ^ B in Q are all of the form ^ in P or Cij ^ Cij in P. 

For claim H let A G (n^oY''"' and B G (7^^o)"'''" be given. About 
C = AB one finds for all i G [/] and j G [n] that 

m m— 1 

Cij = J2 ^^kBkj ^ AikBkj ^ ■ ■ ■ ^ Ai^Bij ^ in P 

k=l k=l 

since Ai^B^j ^ in P and hence Ylt=i ^ir^rj ^ Ylt=i ^ir-Brj in -P for all 
k G [m]. 

Claim [6] can be shown by considering an infinite sequence Ai ^ A2 ^ 
■ ■ ■ in Q. If y4fc > Ak+i in Q, then there must be some position (z, j) such 
that {Ak)ij > {Ak+i)ij in P. Because P is well-founded, there can only be 
a finite number of indices k in which this happens in position Since 
all matrices in this sequence have u}{Ai) rows and a{Ai) columns, there is 
a bounded number of matrix positions at which such descents can happen. 
Hence the number of strict inequalities in the sequence must be finite, and 
thus Q is well-founded. 

Finally, the conclusion that Q is a PROP partial order on (TZ^q)*^' may 
need some elaboration. If ^ A ^ P in m) then there is some P' ^ in 
Q(/, m) such that P = A + P' and hence CAD ^ CAD + CB'D = CBD in 
Q{k, n) for all C G (TZ^o)''''^ and D G (7^^o)'"''"• □ 

The next step will be to exhibit examples of sub-PROPs of TZ*^' where 
the standard order is strict. 

By the first two axioms, x ^ y if and only if there exists some z G TZ^o 
such that y = X + z; hence a semiring partial order is fully specified by its 
semipositive cone. An alternative set of axioms for a subset C of 7^ to be 
the semipositive cone of a semiring partial order are: 

1. OeC. 
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2. C is closed under addition. 

3. C is closed under multiplication. 

4. li X — y + u and y — x + v ior some u,v & C then x — y. 

The last of these is the claim that P is antisymmetric. For a partially ordered 
ring TZ it can be simplified to the claim that {u, —u} fl C has at most one 
element for any u & TZ, but semirings can have x + u + v = x even if 
u + V ^ 0. That the semipositive cone is closed under addition follows from 
transitivity and translation of the partial order, since x,y ^ in P implies 
x + y + y — y ^ in P. That 0^0 implies that is always semipositive. 

The term 'positive cone' suggests that positive elements also form a cone, 
and in many case this is indeed so, but it depends on properties of the 
semiring. 

Lemma 6.3. Let a partially ordered semiring {TZ, P) he given. 

1. If addition is cancellative then strictness of inequalities is preserved 
under translation and x + y & TZ+ for any x e TZ+ and y e TZ^q. 

2. If multiplication is associative then xy G TZ+ for all x,y E TZ+. 

Proof. First assume addition in TZ is cancellative, i.e., x + z = y + z implies 
X = y. li X < y in P then x ^ y in P and hence x + z^y + z in P 
by translation invariance of P. Furthermore x ^ y in P, hence x ^ y, and 
thus X -\- z ^ y -\- z, from which follows that x-\-z^y-\-z in P. Therefore 
x-\-z<y + z in P, i.e., translation by some arbitrary z eTZ preserves strict 
inequalities. To see that x + y E TZ+ when x G TZ+ and y e TZ^o, let w,z eTZ 
such that w < z in P he arbitrary. Then 

w{x + y) — wx + wy < zx + wy ^ zx + zy — z{x + y) in P, 
{x + y)w — xw + yw < xz -\- yw ^ xz -\- yz — {x -\- y)z in P 

where invariance of strict inequalities is needed e.g. to conclude from wx < zx 
(by the x e 7?.+ hyphothesis) that wx + wy < zx + wy. 

Second assume multiplication in TZ is associative. Let x,y E TZ+ and 
w,z eTZ such that w < z in P he arbitrary. Then wx < zx in P and hence 
w{xy) = {wx)y < {zx)y = z{xy) in P, similarly yw < yz in P and hence 
{xy)w = x{yw) < x{yz) = {xy)z in P, which has verified that xy G TZ+. □ 

An example of TZ^ failing to be closed under addition when addition is 
not cancellative can be found in 7^ = B^^^; the matrices ( o ? ) and ( 5 q ) are 
both positive (on account of being invertible) but their sum {W) is not. 
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Lemma 6.4. Let {TZ, P) be an associative unital partially ordered semiring 
with cancellative addition. Let Q be the standard order on TZ*^* . Let Q be 
the set of those elements of {TZ^o)*^* which have at least one element on 7?.+ 
in each row and column. Then the following holds: 

1. If A < B in Q{1, m), and C G (T^j-o)™^" is such that every row contains 
at least one element ofTZ^, then AC < BC in Q{l,n). 

2. If A < B in Q{m,l), and C G (7?.^o)"^™ such that every column 
contains at least one element ofTZ+, then CA < CB in Q{n,l). 

3. If < 1 in P then Q is a sub-PROP of {IZ^o)*^* , and the restriction of 
Q to Q is strict. 

4. // < 1 in P then all elements of Q{n,n) are in the positive cone of 
the partially ordered semiring 

Remark. Since unitality is generally considered to imply 1 7^ 0, the < 1 in P 
condition is equivalent to ^ 1 in P. The case that primarily needs to be 
ruled out is that and 1 are unrelated in P, since that would put the image 
of outside Q. 

Proof. For claim [H one may first observe that B = A + A' for some A' ^ 

in Q{l,m), and hence AC ^ AC + A'C = BC in Q{l,n). Second, there 
must be some position {i,j) G [/] x [m] such that Aij < Bij in P. Let k G [n] 
be such that Cjk G 7^+. Then {A'C)ik = EZi^'ir^rk > A'^jC^k > in P, 
and hence {AC)ik < {BC)ik in P by cancellativity of addition. The proof of 
claim [2] is completely analogous. 

These two claims, together with those in Construction 16.21 demonstrate 
that Q on Q is strict with respect to composition and tensor product. Since 
every row oi A ^ B for A,B & Q contains a row of A or P in its entirety, 
and similarly every column of A ^ B contains a column of A or P in its 
entirety, it follows that Q is closed under the tensor product. To see that it 
is closed under composition, one may consider some arbitrary A G Q{1, m) 
and B G Q{m,n). For any row index i G [/], there is some j G [m] such 
that Aij G 71+ and some k G [n] such that Bj^ G 7?.+ . Hence {AB)ik = 
YlT=i ^irBrk ^ AijBjk > in P, and thus row i of AB contains a positive 
element in column k. Similarly to show that column k of AB contains a 
positive element, one first chooses j G [m] such that Bj^ G 71+ and then 

1 G [/] such that A^j G 71+ . Together they demonstrate that Ao B E Q. 

What remains for Q to be a PROP is that it contains 0(cr) for all per- 
mutations a. These matrices have a 1 in every row and column, which by 
< 1 in P is positive; the special case of = 0(1°) has neither row nor 
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columns, so it gets by without any 1 elements. This completes the proof of 
claim [31 Claim HI finally, is merely the special case I = m = n of the first 
two claims. □ 



Corollary 6.5. Let (TZ, P) be an associative unital semiring with cancellative 
addition, partially ordered so that < 1 in P. Note that the restriction Q 
of the standard order on TZ'^* to Baff (7?.^o) is a PROP partial order. Let B 
he the set of those elements o/Baff(7^^o) which have at least one element of 
71+ in each row and column. Then B is a PROP, and the restriction of Q to 
B is strict. 

Remark. Since an element of Baff (T^^o) has the form 

"1 d 

10, 
b A_ 

the first two columns and first two rows always contain some 1 G 7^+. If 
the A part is chosen as an element of the Q of Lemma 16.41 then the whole 
matrix becomes an element of B, but one may also meet the condition about 
a positive element in each row and column by putting them in the b and c 
parts. 

6.2 Nilpotence 

A second application of the standard ordering of matrices exists in the for- 
malisation of the "may depend on" arrow r\ seen in (11.21) . The final details 
of this will have to wait until Section [TOl but closely related technicalities will 
appear repeatedly in the next couple of sections. What they are all about 
is ultimately the prevention of cycles in the networks being considered, and 
keeping track of things to that end requires some additional operations on 
matrices. 

Definition 6.6. The Kleene star A* of a square matrix A is defined to 
be YlT=o ifiaX series converges. Similarly the Kleene plus of A is 
defined to be Yl^=i if ^^^^ series converges. 

The Kleene star and plus are defined for all A e B"^", since all series in 
B converges; either all terms are 0, and then the sum is 0, or at least one 
term is 1, and then the sum is 1. Over other semirings, existence of A* in 
general depends on the topology, but one case in which it does not is that A 
is nilpotent. 

Lemma 6.7. For any A G B"^", the following are equivalent: 
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1. A" = 0. 



2. A is nilpotent. 

3. The main diagonal of A'^ is zero. 

Proof. It is actually easier to reason about the negations of the given claims. 
Clearly, if A is not nilpotent then 0. 

Next assume A^ ^0. Then there is some nonzero position (io,in) in 
and hence there must be some sequence io, . . . ,in & [n] such that Ai^_^^i^ = 1 
for all /c = 1, . . . , n. By the pidgeonhole principle, there must be ^ A; < 
I ^ n such that ik = ii- Hence the {ik,ik) position of A'"*^ is 1 and it follows 
that the same is true for A'^; not all of its diagonal elements are 0. 

If the position of A'^ is 1 then that position is 1 also in {A'^)'^, and 
by extension in any (A"*")™ for m ^ 1. Since (Xlfeli^'^)'" = Sfclm^'^ ~ 
^'"Sfe=o^^' follows that A"^ 7^ if the {i,i) position of A'^ is nonzero. 
Hence A is not nilpotent. □ 

The relevance of boolean matrices here is that many matrices that are 
nilpotent are so because of their shape: the positions of their nonzero ele- 
ments are such that one can predict based on that alone that a certain power 
is 0. Via the encoding that 1 means 'possibly nonzero' and means 'def- 
initely zero', boolean matrices provide a convenient means of keeping tack 
of such matrix shapes, as an addition or multiplication in T^"-^"- under that 
encoding corresponds to the same operation in B"^". Slightly more formally, 
one can consider the sets of matrices that have the shape of a certain pattern 
of zeroes and ones. 

Definition 6.8. Let 71 be an associative unital semiring. The matrix de- 
pendency filtration of TZ'^* is the family {-Fg}geB«x« of subsets of TZ*^* 
defined by 

Fg= [Ae 7^'"(9)><"(9) I Aij = for aU {i,j) such that qij = } (6.2) 
for all q G B'^V 

The matrix dependency filtration has the important property that if ^ e 
Fq and B e Fr, then AB e Fgr, since if (say) position (i, k) in AB is nonzero 
then there must be some j such that Aij ^ and Bj ^. ^ 0, meaning q^j — 1 
and rj^k — 1, and thus position (i, k) in qr is 1 too. 

Lemma 6.9. Let TZ be an associative and unital semiring. Let {-Fg}geB»x» be 
the matrix dependency filtration ofTZ'^'. If q & B"^" is nilpotent then every 
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A E Fq is nilpotent and A* exists. If 71 is a ring, then A* is the multiplicative 
inverse of I — A. 

If q E B™^" and r G B"^™" are such that qr is nilpotent then rq is nilpo- 
tent, and {AB)*A = A{BA)* for all A e Fg and B e F,.. 
For any nilpotent q G B"^" and A,B ^ Fq, 

{A + B)* = {A*ByA* = A*{BA*y. (6.3) 

Proof. Suppose g™' = 0. Then A™ G Fqm = {0}, demonstrating that A 
is nilpotent. A* = ^21^=0 which clearly exists, and (/ — A) ^2^=0 ~ 
I -A"' = I. 



If qr is nilpotent for q G B'"^" and r G B"'^™' then (qr)'^ = by Lemma IGTI 
and hence (rg)'""'"^ = r{qr)^q = 0, demonstrating the nilpotency of rq. In 
7^•^^ one finds {AByA = EZoi^^yA = EZoMBAy = A{BAy. 

Considering instead {A + By for A,B & Fq where q G B"^" is nilpotent, 
one has of course 

oo oo k 

iA+By = Y,iA + By = j2 E n^(^)- 

k=0 k=0 W:[k] — >{A,B} i=l 

Collecting sequences of adjacent A factors, taking / as the number of B 
factors and ij as the number of As between the j'th and j + I'th 5 factor, 
this last sum can be rewritten as 

oo fc I I 

EE E n = E E n = 

k=0 1=0 io,..;ii>0 j=l OsSisSfc io,..;ii>0 j=l 
joH \-ii=k—l ioH \-ii=k—l 

I oo I 

= E E a'^'Wba'^ = ^a*Wba* = A*{BA*y, 

with the other variant following from the previous claim in the lemma. □ 

Lemma 6.10. For any A G B'"^™, B G B™''", C G B"''™, and D G B"^", 
the following are equivalent: 

1. [cd] nilpotent. 

2. A, D, and A*BD*C are nilpotent. 

3. A, D, and D*CA*B are nilpotent. 

4. A and D + CA*B are nilpotent. 
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5. D and A + BD*C are nilpotent. 



Proof. Equivalence of |2] and [3] is immediate from Lemma 16.91 

Now assume [1] and let q = [c £>]■ nilpotency of A and D, one 

may observe that 







'A 


B 


m+n 


'A 


0" 


m+n 


C 
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Let = [(m + n)/2] . By Lemma [6.7[ q^^ = and hence the nilpotency of 
A*BD*C and D*CA*B follows from 
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It has thus been shown that [T] implies [2] and O 

Conversely assuming that A, D, A*BD*C, and D*CA*i? are nilpotent, 
one may let M = max{m, n} and observe that the Mth power of any of these 
four expressions is 0. Next consider 
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g* = 



where the first line inequality holds because any term in the expansion of 

([o £>] + [c'o])^*^ which has more than M consequtive factors is 

since A^ = = 0; the remaining terms have at least 2M factors [c- f ], 
and the star factors before and after cover all possibilities for what else there 
may be in one of these terms. This has shown that [2] and [3] imply [TJ 

Next consider the matter of whether [2] is implied by O The nilpotence of 
D is common to these. For A, it is clear that A"^ ^ {A + BD*C)"^ = 0. For 
A*BD*C, it follows from Lemma [63] that 



{A*BD*C)+ = A*BD*C{A*BD*C)* -- 



A*{BD*CA*yBD*C = 
BD*CyBD*C ^ (A + BD*cy 
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and thus the left hand side cannot have any nonzero diagonal elements since 
the right hand side does not have any. It is similarly shown that H] implies El 
For the converse, the nilpotence of D is again not an issue, so the task is 
to show that A + BD*C is nilpotent. Here it is convenient to assumed! since 
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^ (g + qq*q)^ = 



and the all zero diagonal of q^ thus requires [A + BD*C)^ to have an all 
zero diagonal as well. This has thus shown O and again the argument for H] 
is completely analogous. □ 

Lemma 6.11. Let TZ be an associative and unital semiring. Let {-Fgjgei'x* 

he the matrix dependency filtration of TV'. Let q = [f^l fi] G b("^+")x 
where qu E B™^*" and g22 € B"^". If q is nilpotent then 

{Al,Ai2A*,A2iyAl, 
A*^A2i{Al,Ai2A*^A2iyAl, 
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(6.4) 



for all All e Fq^i, A12 G Fg^.^, A21 G Fg^-^, and A22 G Fg^^. 



Proof. That q is nilpotent ensures that the left hand side exists, whereas 
the conditions for Lemma (6.91 to imply thay all stars in the right hand side 
exist are that gn, ^22, qiiqi2q22l2i, and g22Q'2iQ'ii?i2 are nilpotent, but the 
combination of those is equivalent to the nilpotency of q by Lemma I6.1U[ 
Under these conditions, it follows from other claims in Lemma 16.91 that 
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□ 



6.3 Filtration and transference 

The matrix dependency filtration is not an isolated construction, but rather 
the basic example of a very general concept. 

Definition 6.12. Let V and Q be PROPs, and let Q be PROP quasi-order 
on Q. A (Q, (5)-fiItration in is a family F — {-Fg}geQ of subsets of V 
such that: 

1. For all m, n e N, and every q e Q{m, n), FqC. V{m, n). 

2. If g ^ r in Q then Fq C F^. 

3. a^b E Fgfgir for aU q,r E Q, a E F^, and 6 G F^.. 

4. a oh E Fgor for all q,r E Q such that a{q) — uj{r), all a E Fg, and all 
b E Fr. 

5. 0-p((j) E -^</.q((t) for all n e N and a E E„. 

F is a (Q,g)-filtration of V if V{m,n) = U5GQ(m,n) ^9 fo^ all m,n e N. A 
filtration F is 7?.-Iinecir if every component Fg is an 7?.-module. 

For q,r E B™^"^, q ^ r means rij — =^ = 0, and hence Fg C Fj. in 
the matrix dependency filtration. Verifying the property is a simple matter 
of keeping track of which matrix positions in the factors correspond to which 
matrix positions in the product, and the permutation property is immediate 
from the definition of in a matrix PROP. The matrix dependency filtration 
is moreover 7^-linear. 

As with filtrations in rings, one can use the form of an expression for a 
specific element to argue that this element must be in a specific component 
of a filtration. 
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Lemma 6.13. Let Q be an N'^-graded set, V and Q be PROPs, Q a PROP 
quasi-order on Q, and {Fg}q^Q be a {Q,Q) -filtration in V. If f : Q — > V 
and J : fl — > Q are -graded set morphisms such that f{x) e -^j(x) for all 
X e then 

eval/(G') G Fcvai,;(G) for all G E Nw(fi). (6.5) 

Proof. Consider first the case that G = {V, E, h, g, t, s, D) has no inner ver- 
tices. Then a := g o is a permutation and eval/(G) = (p-pla) e F^Q{a) — 

-^evalj(G)- 

Consider next the case that G has one inner vertex v with decoration 
X = D{v). Then G = Nw(j^ | {v : x)\^ for some k, 1, m, n such that |k| C |m| 
and |1| C |n| but |k| n |1| = 0. Hence 

evaVlG) = [I, I f{x)\]^ = g-/^) 1 1]^ o /(x) ® \ l]^ o g^/,) | l]^. 

Now f{x) e Fj(^x) by assumption, and 




and similarly 




Thus eval/(G) e Fg for 

? = E"/'^ I 1] s ° J(^) ® K I 1] Q ° tewk) I 1] s = [m I J{^)f] Q = eval.CG). 

Finally, induction over the number of inner vertices is used to establish 
the lemma in the remaining cases. When there are at least two inner ver- 
tices, there is some cut {Wo,Wi,p) in G such that neither Wq nor Wi is 
empty. Hence the obvious induction hypothesis applies to both parts of the 
corresponding decomposition (Go, Gi) of G, and thus 

eval/(G) = eval/(Go) oeval/(Gi) e Fevalj(Go)oevalj(Gi) = ^evalj(G)- 

□ 

It is not at this point in the exposition possible to apply the filtration 
concept to the networks themselves, since it has not yet been established that 
these carry a PROP structure for a filtration to be related to, but one can 
define something which keeps track of pretty much the same information as 
a dependency filtration would. 
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Definition 6.14. The transference of a network G is the matrix Trf(G) G 
^ui{G)y.a{G) ^j-^ich has 1 in position (i, j) if and only if there is a directed path 
from 1 to in G such that the initial edge has tail index j and the final edge 
has head index i. 

As defined, transference is a purely syntactic concept. Its main applica- 
tion will be to predict whether a network has some output that could be fed 
back to an input without creating a cycle; this is a key part of the formali- 
sation of the "may depend on" arrow r\ seen in (11.21) . Obviously, if position 
(i, j) in Trf(G) is 1 then joining the iih. output of G with its jth input will 
create a cycle. The purpose of making the transference a matrix is to handle 
simultaneous joining of several inputs and outputs, as it turns out nilpotence 
and the Kleene star are exactly the concepts needed to keep track of things 
in that situation. 

If viewing networks as circuits, a more conceptual description is that the 
transference keeps track of which inputs contributes to which outputs. The 
classical information interpretation of the transference of a network is thus 
that a in some position (z, j) signals that "output i cannot depend on input 
j, since there is no path along which such information could be carried." 
Whether this interpretation is valid will however depend on the PROP in 
which a network is evaluated; there are sometimes mechanisms which can 
be used as loopholes to escape that conclusion about how information may 
be transferred, especially in "quantum" (or more generally linear) PROPs. 
There are for example PROPs with a "cup" element U in the (0, 2) component 
and a "cap" element A in the (2, 0) component which satisfy the equation 
I A"*f/i,c] = 0(1^) = [a I f^cfeA^"^] ; this will happen if U is an inner product on 
a finite dimensional vector space and A is the corresponding inner product on 
the dual vector space. The transference of the networks Nw(^ | A'^^'Ubc) and 
Nw(^ I UcbA'"') is 0, but they may anyway evaluate to the identity (which puts 
"exactly the same information" on the output as it receives from the input) 
in a particular PROP. Attempting an information transfer interpretation of 
transference may thus be somewhat tenuous, but the same is true for network 
expressions in general: in [l | UcbA^"'] , one interpretation is that cups and caps 
can "reverse the direction of time" (causality), whereas another is that the 
cap A outputs a state J2x that is a superposition of all pairs of identical 
basis states and conversely the cup U destroys (maps to 0) all histories where 
its two inputs are not equal. Neither interpretation is particularly physical, 
although the second bears some resemblance to quantum teleportation (but 
noticeably missing the steps involving classical information). 

Yet another view of transference is that it is an evaluation of a network. 
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Lemma 6.15. Let Q be an N"^ -graded set, and let J: Q — > M*^* be the 

N'^-graded set morphism which maps every x eVL to the uj{x) x a{x) matrix 
of ones. Then Trf(G') = evalj(G') for every network G G Nw(i7). 

Proof. Beginning with networks without inner vertices, one may observe that 
any path in that case has the form e 1 (written going right-to-left) for some 
edge e. Hence the (i, j) entry of Trf(G) is 1 if and only if g~^{i) = s~^{j), 
which is precisely the defining condition for the permutation matrix 0b.x.((t) 
for a = g o s~^. This permutation matrix is also what eval j(G') is defined to 
be. 

Next considering networks G = Nw(^ | {v: x)^), one immediately finds 
that eval J (G) = J{x) is a matrix of ones. Trf(G) also consists only of ones, 
since e f / 1 is a path from 1 to for any e G |a| and / G |b|. The equality 
has thus been verified for both base cases. 

If the network G has a split (Fj, Fj.,Wi, W^) then Lemma 15. 121 implies that 



eval J (G) = evalj(Gi) evalj(Gi.) 



evalj(Gi) 
evalj(Gi. 



for the corresponding decomposition {Gi, Gj.) of G. On the transference side 
of things, any path from 1 to in G is either a path in Gi or a path in G,-. 
From the definition of split (in particular the modification of indices in the 
right component), it thus follows that 



Trf(G) 



Trf(Gi) 
Trf(Gr) 



Hence if Trf (Gi) = evalj(Gi) and Trf (G,) = evalj(G,) then Trf(G) = evalj(G). 
In particular, the lemma claim holds for G = Nw(^c | ^b)- 

Similarly, if the network G has a cut (Wq, Wi, q) inducing a decomposition 
(Go,Gi) then Lemma 15781 implies that evalj(G) = evalj(Go) evalj(Gi). On 
the transference side of things, if Trf(G)i^fc = 1 then a corresponding path 
P from 1 to in G contains exactly one cut edge e. The edges up to and 
including e induce a path Pi in Gi from 1 to 0, and the edges from e and on 
induce a path Pq in Go from 1 to 0, meaning Trf (Go)i,q(e) = Trf (Gi)q(e),fc = 1- 
Hence Trf(G) ^ Trf(Go) Trf(Gi). Conversely, if Trf (Go)ij = Trf(Gi)^- ^ = 1 
then there is a path Pq from 1 to in Go whose first edge is q^^{j) and whose 
last edge has head index i, and also a path Pi from 1 to in Gi whose first 
edge has tail index k and whose last edge is q~^{j). Combining these in G 
yields a path P from 1 to whose first edge has tail index k and whose last 
edge has head index i. It follows that Trf (Gq) Trf (Gi) ^ Trf(G). Hence if 
Trf(Go) = evalj(Go) and Trf(Gi) = evalj(Gi) then Trf(G) = evalj(G). 
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From the recursive definition of tlie abstract index expression defining 
evalj((j), one gets a multicut decomposition of G into parts wliicli are eacli 
eitlier on tlie form Nw(^ | l) or on tlie form Nw(^^ | x^) . Since Trf and evalj 
coincide for all of these, it now follows that Trf(G') = evalj(G) in general. □ 

An alternative way of arriving to the same conclusion would be to use 
Example 15.18^ since every 1 in the result there can be traced back along a 
path to the input. 

Corollary 6.16. Let V he a PROP, Vt he an n'^ -graded set, and f : Vt — vV 
he an N'^-graded set morphism. If {Fq}g^^»x» is a filtration ofV then for any 
network G of Q, 

eval/(G) GFTrf(G). (6.6) 

Proof. In Lemma I6.13[ take Q = M'^' and let J{x) be the u{x) x a{x) 
matrix of ones. Then J{x) is the maximum element in B'^'^^-'^'^^^'' and hence 
-^j(x) = V[co{x),a{x)) because {Fq}q^^.x. is a filtration of V. The claim 
now follows from Trf(G) = evalj(G'). □ 



7 Subexpressions 

With the view of networks as "PROP expressions" firmly established, and 
some technical lemmas taken care of, it is now time to consider what it 
would mean for one network to be a subexpression of another, as that is an 
initial step of doing rewriting. 

The categorically inclined might suggest as definition that A is a factor/ 
subexpression of -B iff i? = Gi o C2 ^ A ^ G^ o G4 for some Gi through 
C4, or perhaps even streamline this to the equivalent condition that B = 
G[oA^(j){\'')oG'^ (combine G2 and C3 with Ci, then insert some permutations 
to get rid of one of the ® factors). This is equivalent to being a convex 
subnetwork, but that is in fact unnecessarily restrictive. A better starting 
point is the abstract index notation, which rather suggests the concept that a 
naked expression A is a subexpression of any naked expression B = AG, i.e., 
A is a subexpression of B iff padding A with some extra factors G produces B 
(after some minor cleanup, such as renaming labels). The smallest example 
that demonstrates the difference is probably fll.2nl) since 

= (/.(|i)®/io0(|i)®^®(/)(|i)o0(iXi^|i)®5o</,(|i)® A®0(|i)o0(|i)® A 
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is a subexpression of 



= (f){\^) <S>iio 0(1^) (g) (8) 0(1^) o A (8) 0(1^) (g) 5" o A (g) 0(1^) o A 

in the latter sense, but not in the former; in the more transparent network 
notation, the two expressions are 
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The obstruction is that the extra A is connected to the A subexpression both 
with an incoming edge (a) and with an outgoing edge (e), so it cannot be 
in either of Ci or C4, but it can be in a generic product C of abstract index 
factors. 

At first sight, such non-convex subexpressions may seem strange, and 
downright implausible — why would one want to look for that as a subex- 
pression? — but experience seems to indicate that riiles with this kind of left 
hand side arise naturally as soon as the rules become complicated enough 
for nonconvexity to occur. When a nonconvex rule is a derived rule, it can 
always be understood as a combination of more elementary rules (some of 
which may be used backwards), and these may of course encircle vertices 
outside the subexpression that is being acted upon, because the mere fact 
that two vertices in an expression are affected by rules does not necessarily 
imply that all vertices on every path between those vertices are affected by 
some rule as well. (Such a conclusion could however be drawn in cases where 
all expressions are treelike, since in that case there would only be one path 
to consider. Nonconvexity of rules can therefore be viewed as a complication 
that arises when generalising from treelike to general DAG expressions.) 



7.1 The symmetric join 

What is then the network counterpart of the abstract index "multiply by 
some naked expression"? As the example indicates, it would be a network 
where paths can go back and forth between the two factors, so it follows that 
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Figure 4: Symmetric join of two networks 

a general construction may end up looking somewhat like Figure |H This 
raises the problem of knowing whether the end result will obey the acyclicity 
condition for a network, but luckily all aspects of the parts that are relevant 
for this are recorded in their transferences. 

Construction 7.1 (Symmetric join). Let Q be an N^-graded set with y E Q 
such that a{y) = (jj{y) = 1. Let k, I, m, n,q,r E N, 

K = {VK,EK,hK,gK,tK,SK,DK) e Nw(fi)(fc + r,/ + s), and 
H = {VH,EH,hH,gH,tH,SH,DH) e Nw(fi)(s + m,r + n) 
be given. Consider Figure |H Define 

K^lH:={V,E,h,g,t,s,D) 

where 

E = {2e}eei?^U{2e + l}egs^, 

V = {0,l}\J{v en\l ^r + q}\j 

U {r + g + 2v}^(.Vk\{o,i} 0{r + q + 2v + l}veVH\{o,i} , 
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D{v) 



{Kg){2e) 



{h,g){2e + l) 



(t,s)(2e) 



(t,s)(2e + l) 



V ■ 



■r ■ 
■r ■ 



y ifl^f — 2^r + g, 

DK{[iv-r-q)/2\) if > 2 + r + g and 2 
DH{[{v-r-q)/2\) ii v > 2 + r + q and 2 

r + q + 2hK{e),gK{e)) if /i/r(e) 7^ 0, 

0,fi'A'(e)) if /i/^(e) = and 5(i^(e) < fc, 

2 + gK{e) — k, l) if hxie) = and gxie) > k, 

r + q + 2hH{e) + l,gH{e)) if hnie) ^ 0, 

2 + r + gH{e), l) if hnie) = and gnie) ^ q, 

0, k + hnie) —q) if /i//(e) = and (7/^(6) > g, 

r + g + 2ti^(e),Sii-(e)) if ti^(e) 7^ 1, 

1, Sii-(e)) if t/^(e) = 1 and s/^(e) ^ /, 
2 + r + Si^(e) — /, 1) if t/^(e) = 1 and s/^(e) > /, 

r + q + 2tH{e) + l,SH{e)) if t^le) 7^ 1, 



Let 



ail ai2 

fl21 C^22 



2 + sj^(e),l) 
l,l + SH{e)-r) 



Trf(ir), 



sgxr 



if tH(e) 
if tnie) 



&22 
^32 



&23 
&33 



1 and Si^(e) ^ r, 
1 and s/ffe) > r. 



Trf(if) 



where 022 G B*"^"^ and 622 G 

If 022^22 is nilpotent then (V, ii^, h, g, t, s, D) G Nw(r2)(/c + m, Z + n) and 



Trf(ii' H) 



ail + ai2&22(a22&22)*a21 ai2(^'22a22)*fc23 

&32(a22fe22)*a21 &33 + ^32022 (fe22a22)*&23 



• (7.1) 



Remark. In Section [9] it will be shown that (17.11) is a special case of the 
formula fimi) for eval/(ir if). 

In practice, the join-vertex annotation y is typically going to be a "neu- 
tral" symbol \\ that is not present in the primarily under consideration, but 
rather in some extended = f2 U {t]}. Such \\ vertices are mostly there for 
technical purposes and should not contribute any mathematical content, but 
since it for some results makes no difference either way, these will be stated 

V 

for a general y G 1). Notationally, the y may be omitted from n when 

Another notational simplification is that K ><^j:^j if, i.e., when the right 
part H is completely engulfed by iT, is written K >i H. This annexation of 
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one network {H) into another [K) is the original apphcation for n, but it 
turned out the more general symmetric join was useful when proving things 
about it. 

Proof. The first claim to verify is that the unions in the formulae for E and 
V really are distinct. For E this is immediately clear (any 2e is even, any 
2e + 1 is odd), and the same idea is used for the last two parts of V. When 
it comes to separation of these two from the previous parts, one must realise 
that V ^ 2 for V E Vk \ {0, 1} or V G Vh \ {0, 1}, so the least element that 
can be found in these latter parts is r + g + 4, whereas the largest join vertex 
label is r + g + 2. That there is never any r + g + 3 G V, nor 2 G V^, is 
deliberate — the gaps simplify the formulae, and an offset of 2 for the join 
vertex labels is more visible than an offset of 1. 

Once it is realised that the definitions of E and V are mostly about 
relabelling old vertices so that K and H don't collide, it should be clear 
that the top cases of the definitions of h, g, t, and s are merely reproducing 
the inner parts of K and H. The remaining two cases deal with external 
edges, and have to distinguish between external edges that get joined up 
and external edges that remain external. The deciding factor here is the 
head and tail indices, and it is easily checked that everything works out as 
suggested in Figure |H At the same time, one may verify that the conditions 
for L = (V, E, h, g, t, s, D) to be a network, save the acyclicity condition, are 
automatically fulfilled. 

Now consider a walk (in practice, a path or cycle) P = vnGnVn-i ■ ■ ■ eifo 
in L. This has a decomposition at vertices v ^ 2 + r + q into subpaths with 
all of their edges from either K or H. If in particular v^, Vq ^ 2 + r + q then 
each such subpath gives rise to a 1 in some a^j or bij matrix. Say a walk is 
odd if all edges in it are odd (i.e., come from H) and even if all edges in it are 
even (i.e., come from K). Then there is an odd path from 2 + jto2 + r + i 
if and only if the position in 622 is 1, and there is an even path from 

2 + r + j to 2 + i if and only if the {i,j) position in 022 is 1. 

Any cycle P in L must contain some edge from H and some edge from 
K, since neither H nor K contain a cycle within themselves. Hence one can 
assume vq = vn ^ 2 + r for P that is a cycle. The matrix 022^22 has a 1 in 
position if and only if there is an odd-even path combination that goes 
from vertex 2 + j to vertex 2 + i. For a cycle P consisting of 2p subpaths 
(alternatingly odd and even), it follows that the {vq — 2,fo — 2) position of 
(022^22)^ must be 1. Therefore any cycle in L will give rise to a 1 in the 
main diagonal of (022^22)"'', but if 022^22 is nilpotent then the main diagonal 
of (022^22)"'' is zero by Lemma 16771 Thus L will be a network whenever 022^22 
is nilpotent. 
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Finally consider fl7.ip . Let P be a path from 1 to with s{ei) > I and 
g{e]y) > k. Then ei and are both odd. If all edges in P are odd then it 
corresponds toapathini?, and hence the [g{eN) — k+q, s{ei)—l+r) element 
in Trf(if), and equivalently the {g{eN) — k,s{ei) — l) element in 633, is 1. 
Otherwise P consists of some 2p+l ^ 3 segments which are alternatingly odd 
and even; let fo = Mq, Mi, • • • , M2p+i = he the segment boundary vertices. 
As stated above, this implies that the {u2i — 2, ^21-1 — 2 — r) position of 022 
is 1 for 2 G [p], and also that the (u2i+i — 2 — r, n2i — 2) position of 622 is 1 
for i G [p — 1]. Similarly the (ui — 2 — r, s(ei) — Z) position of 623 and the 
{gi^-N) — k,U2p — 2^ position of 632 must be 1. Hence the [g{eN) — k, s{ei) — l) 
element in 632022 (^'22a22)^~^&23 must be 1. Since this holds for an arbitrary P, 
it follows that 633 + 6320-22 (622a'22)*623 is an upper bound for the lower right 
m X n submatrix of Trf(L). From similar considerations in the other three 
quadrants, it follows that the left hand side of (17. ip is ^ the right hand side. 

Conversely, any 1 in the right hand side of (17. ip corresponds to a 1 in 
some position in one of the component terms. Each such term is a product of 
alternatingly a^j and bji matrices, so that 1 corresponds in turn to a sequence 
(wp, 'Up„i), ("Up-i, 'Up-2), {ui,Uo) of positions such that {uj,Uj^i) is 1 in 
the j'th factor from the end. For each such position that is 1, there is a 
corresponding path in K or H respectively, and any path corresponding to 
{uj,Uj-i) joins up in L with any path corresponding to {uj+i,Uj), at the 
common vertex 2 + Uj (if the factors are on the form 6^2021' ) ot 2 + r + Uj (if 
the factors are on the form 0^2622')- Joining up all segments produces a path 
from 1 to in L, so the left hand side of (17. ip is ^ the right hand side. □ 



The symmetric join has several nice algebraic properties. 

Lemma 7.2. Let an W'-graded set VL, not necessarily distinct y, z E fi(l, 1), 
and G,H,K E Nw(fi) be given. Let 



All A12 
A21 A22 



:= Trf(G), 



-B22 -B23 B2A 
B32 -B33 B34 
-B42 -B43 B44 



C44 C45 
C54 C55 



:= Trf (fsT) 



where the block sizes are such that An is i x j , A22 is p x q, B22 is q x 
p, B33 is k X I, B44 is r X s, C44 is s x r, and C55 is m x n for some 
i, j, k, I, m, n, p, q,r,s E N. 

If A22B22, B44CM, and (v422-B22)*^22-B24C44(-B44C44)*-B42 o^ nilpotcnt 
then both sides of (17.21) are networks of Q and 



(7.2) 
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y 2 

Proof. That A22-B22 and -B44C44 are nilpotent ensure that G H and H 
K respectively are networks. That also {A22B22)* A22B2iCii{Bi^Cii)* B42 is 
nilpotent implies by Lemma [6.101 that the matrices 

A22B22 A22B24C44 , . 

B44C44 + -842(^22-822) *^22-B24C'44 C^-^) 
^22-^22 + A22B2iC4i{^BaCii)* B42 ^ ■'^) 

are nilpotent too. That fl7.4p is nilpotent is the condition for (G H) -fC 

y 2 

to be a network, whereas the condition for G [H -fC) to be a network 
is that fl7.5p is nilpotent. 

The isomorphism (x, ip) from left hand side to right hand side is imme- 
diate from the interpretation of N as mainly making a combined copy of its 
factors: 

%p{Ae) = 2e e G 

?/'(4e + 2) = 4e + l e e Eh, 

^(2e + l)=4e + 3 eeEx, 
X{r + s + 2{p + q + 2v)) =p + q + 2v v G Vb\{0,l}, 

x{r + s + 2{2 + i)) =2 + i ie[p + q], 

X{r + s + 2{p + q + 2v + l)) = p + q + 2{r + s + 2v) + l v G Vh\{0,1}, 
x{2 + i) =p + q + 2{2 + i) ie[r + s], 

x{r + s + 2v + l) =p + q + 2{r + s + 2v + l) + l v G Vk\{0,1}, 
X{i)=z «G{0,1}. 

To verify that this really is an isomorphism, one would on one hand check 

that it preserves incidences within each part, and on the other check that 

the parts are joined in the same way in the left and right hand sides. As an 

example of the latter, one may consider some input e of H, which corresponds 

y y z z 

to edge 2e + l in GnPR, edge 4e + 2 in {Gh'pH) M^-fT, edge 2e in HnlK, and 

edge 4e + l = ^(46 + 2) in GN^(i/ N^iT). If Siy(e) ^ p, then the head of that 

2 

edge is the input vertex 1'm.H and H i><lK, but a join- vertex decorated by y 

y 

in the other three, carrying the label 2+SH(e) in GtA^H, r+s+2(2+Siy(e)) in 

{G^PH)><IK, and again 2 + sj^(e) = x(r + s + 2(2 + SH(e))) mG^P{H^lK). 

If p < sjy (e) ^ p+k then the tail is the input vertex 1 in all five networks, but 

2 y 
the tail index varies: it is snie) in H and H t/ilK, but i + SKie) — k in G t/i^H, 
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{GmPR) mIK, andGMP{H ^IK). Finally if if SH(e) > p + A; then it is in H 

y 

and G n^^H that the tail is the input vertex 1, and in the other cases it is a 

2 

join-vertex decorated by namely that labelled 2+r + SH{€)—p—k in Ht^lK 

y ^ 

and {G\aPH)]^IK, hnt p+q+2{2 + r + SHie)-p-k) = x(2+r + s/f(e)-p-A;) 
inGNP(i7<K). □ 

Lemma 7.3. For every N'^-graded set Q, numbers k,l,m,n,q,r G N, net- 
works K G Nw(i7)(A; + r,l + q), H e Nw(i7)(g + m, r + n), and y G 1), 
it holds that 



*=X™ ■ {K n; i/) ■ "X' ~ (^X™ ■ ■ "X") (^X" ■ K ■ "X') (7.6) 

whenever either symmetric join is defined. 

Remark. On one hand, this lemma states a symmetric join can be moved 
out of (some) permutations, so it is a kind of distributivity. On the other, it 
states that 



is isomorphic to 



and these diagrams are schematic in the sense that any "wire" above can be 
replaced by any number of parallel "wires" (as long as these do not cross 
among themselves). 





Proof. Writing 



one finds 



Trf (*^X" ■ K ■ '^X') 



A21 A22 



A22 A21 
A12 All 



Trf(/7) 



B22 B23 
B32 -B33 



Trf ("X"^ ■ H ■ "X") 



-S33 -B32 
B23 B22 



meaning the condition for either side to be defined is that A22B22 is nilpotent. 

The isomorphism (x, ip) from left to right hand side of fl7.6p is a straight- 
forward relabelling; in the left hand side the K edges are even and the H 
edges are odd, whereas in the right hand side it is the other way around, so 
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■0(e) — e-\- {—ly (add 1 if even, subtract 1 if odd). For the vertices it is 
given by 



x{v) = V for w G {0, 1}, 

x(2 + i) = 2 + q + i for i e [r], 

x(2 + r + i) = 2 + i for ie[q], 

X{r + q + 2v) = q + r + 2v + l for v G Vr- \ {0, 1}, 

X{r + q + 2v + l) = q + r + 2v for v G \ {0, 1}. 

The thing that needs to be checked is primarily that both sides attach K- 
and i7-legs in the same way. 

Suppose e G Ek has hxie) = 0. In the left hand side, 2e will go with 
head index 1 to the join-vertex 2 + gxi^) — if gxie) > k, and to the output 
vertex with head index ''X™ ((/A'(e)) — +5'x(e) if gK{e) ^ k. In the right 
hand side, if ^X*^' [gKi^)) > r (i.e., if gKi^) ^ k) then 2e + 1 = ip{e) will go to 
the output vertex with head index m + ^X*" ((^^(e)) — k = m + g^ie), and if 
*^X'"(5'i^(e)) ^ r (i.e., if gxie) > k) then 2e-|-l = ip{e) will go with head index 
1 to the join-vertex 2 + g + '=X''(5(i^(e)) = 2 + q + gK\e)-k = x{^ + QK^e) -k) . 
The other three cases (out-legs of H, in-legs of K, and in-legs of H) are 
checked in the same way. For the in-legs, it may be useful to observe that 
e.g. (^X^-i = ^X«. □ 



7.2 Homeomorphisms 

The beauty of algebraic identities aside, it is time to get back to the matter 
of network subexpressions, because the symmetric join by itself does not 
completely define such a concept. When B = CA m naked abstract index 
notation, there are typically some indices that are common to C and A, but in 
L = KXgH there is no corresponding commonality of edges. Instead an edge 
from K is joined with an edge from H by means of a new neutral vertex, which 
in abstract index notation would correspond to doing all joining by means of 
Kronecker delta factors. What more is needed for a network subexpression 
concept is thus a way of getting at what the combined network would be if 
such Kronecker factors were eliminated. 

Definition 7.4. A network homeomorphism from 

{VL,EL,hL,gL:tL:SL,DL) to G ^ {Vq, Eq, ha, go^to: Sq, Dq) 

is a pair (/S,7), where 7: E^ — > Eq and j3: Vq — > Vl (note reversal) are 
such that: 
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1. ^(0) = 0, = 1, and p is injective. 



2. 7 is surjective. 

3. Dl{P{v)) = Dg{v) for all G 1/g \ {0, 1}. 

4. If e e satisfies /iL(e) G im/3 then /iL(e) = {l3ohGO^){e) and 5'L(e) = 
(fl'G°7)(e)- li e e El satisfies iL(e) e im^ then ^^(e) = {/3 o to o ^){e) 
and SL(e) = (sG0 7)(e)- 

5. If e Vl \ im /3 then a{DL{v)) = uj{Dl{v)) = 1 and 7(e) = 7(/) for 
the e^feEi such that hiie) — v — tL{f)- 

A y-homeomorphism is a homeomorphism such that Dl{v) = y for all 
e Vl \ im^. A y-subdi vision of a network G is some network L from 
which there exists a y-homeomorphism to G. 

Lemma 7.5. Let {(3,^) be a network homeomorphism from 

L = {VL,EL,hL,gL,tL,SL,DL) to G = {VG,EG,hG,gG,tG,SG,DG) 

and let X = ira (3 C Vl- For every e G Eg, the set p(7)({e}) has the form 
{ei, . . . ,e„} where tL{ei) G X, hL^ei) — iL(ei+i) ^ X for i e [n — 1], and 

Proof. Let E = p{-f){{e}). U v e X n p{tL){E) then v = /5(t^(e)) by 
definition of homeomorphism. Furthermore if / G -E is such that tiif ) G X 
then Si,(/) = SG{e) by definition of homeomorphism. Since = /3(tG(e)) 

and = SG{e) uniquely identify / as an edge of L, there can be at most 

one f e E with tiif) & X; this will be the edge Ci G E. 

In order to exhibit this Ci, one may pick an arbitrary fi^E and pro- 
ceed iteratively as follows: If tilfi) G X then ei = /», and otherwise 
(a o Dj;^ o tL){fi) = 1, meaning there is a unique /j+i G -El such that 
hL{fi+i) = tiifi). By acyclicity of the network L, /j+i ^ {/i, . . .,/,}, and 
by definition of homeomorphism 7(/j_|_i) = e, so /j+i G Since E is fi- 
nite, this will produce ci after a finite number of steps. Then one may 
work in the opposite direction and define Cj+i G E^ to be the unique edge 
with tiici+i) = hiiei), for as long as hL^ei) ^ X] again uniqueness is be- 
cause {uj o Dl o hL){ei) = 1, Cj+i G by definition of homeomorphism since 
hhi^i) ^ X, and eventually there is some e„ for which /iL(e„) G X since is 
finite and L contains no cycles. 

The above has exhibited a sequence ei, . . . , e„ G -E satisfying the stated 
conditions for heads and tails, so what remains is only to establish that these 
are all the edges in E. However, had there been some /G-E\{ei,. 
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then even when taking / as /i one would still have to arrive at the same ei, 
so not being able to conversely reach / from ei would contradict the network 
nature of L. □ 

It may be observed that homeomorphisms can be composed to form new 
homeomorphisms; the composition of (/3i,7i): L — )■ G and (/325 72): G — > 
H is o /32,72 o 7i) : L — > H. It follows that the networks constitute a 
category with homeomorphisms as morphisms. It may also be observed that 
every isomorphism gives rise to an invertible homeomorphism: if (x, ip) is an 
isomorphism from G to H then {x~^,4') is a homeomorphism from G to H. 
Conversely, a pair of homeomorphisms with common target will give rise to 
an isomorphism if they subdivide each edge the same number of times. 

Corollary 7.6. Let G = (Vg, Eq, ho, gctc, ^g, Dq) be a network, and let 
Li and L2 be y- subdivisions ofG for some y. If the homeomorphisms 71) 
from Li to G and (/32,72) from L2 to G satisfy ||3(7i)({e}) | = |p(72)({e})| 
for all e G Eg, then there is a unique isomorphism {x, ip) from Li to L2 such 
that x° f^i = f^2- 

Proof. The condition X ° f^i = (^2 defines x 01a im/3i, i.e., those vertices that 
are endpoints of those paths that by Lemma 1731 constitute the inverse image 
of an edge in G. Since these paths have the same length in L2 as in Li, 
there is a consistent extension of x to all vertices and a related definition of 
ip which is to map the ith edge of p(7i)({e}) to the ith edge of p(72)({e}), 
for each e G Eg- The annotations match because all vertices not in im/3i or 
im 132 respectively have annotation y. □ 

Continuing to explore the relation between isomorphisms and homeomor- 
phisms, one may observe that having a common subdivision can be a way of 
showing that two networks are isomorphic. 

Lemma 7.7. Let Q' be an N'^-graded set with some y G ^^'(1, 1), and define 
fl = Q' \ {y}. Suppose 

L = {V, E, h, g, t, s, D) is a network of Q' , 

Gi = (Vi, El, hi, gi, ti, si, Di) is a network of VL, and 

G2 = (V2, E2, h2, g2, t2, S2, D2) is a network ofVl. 

If there are y-homeomorphisms (/3i,7i): L — )■ Gi and {(32, '^2)- L — )■ G2, 
then Gi ~ G'2- 

Proof. Since Gi is a network of Q ^ y and (/9i,7i) is a y-homeomorphism, 
it follows that D[v) = y for some v E V if and only if w ^ im/3i. Since 
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furthermore is injective, it follows that x = P2 ° Pi is a bijection from 
Vi to V2, which satisfies x(0) = 0, = 1; and Di = D2 o x- For the 
corresponding edge map ip\ Ei — )■ E2 it is natural to use the definition 
■^(71(6)) = 72(e) for all e G -E, as the fact that (/3i,7i) and (/32,72) are 
homeomorphisms immediately fulfils all the conditions for (x, ip) to be an 
isomorphism, provided that this ip is well-defined and a bijection. 

To that end, let e,e' G E such that 71(e) = 71 (e') be given. By Lemma 17751 
there are then ei,...,e„ G E such that h{ek) = t{ek+i) ^ im/3i for all 
k E [n — 1] and i,j G [n] such that Cj = e and cj = e'. Hence there is between 
e and e' a sequence of vertices not in im/32, and this implies 72(e) = 72 (e'). 
Thus is indeed well-defined. Exchanging the roles of 71 and 72 in this 
argument demonstrates that ip is invertible, so it is also a bijection. □ 

But let's get back to the subexpressions. As it should be, removing "Kro- 
necker delta factors" from a network will not change its value. 

Lemma 7.8. Let a network G of Q and a y -subdivision L of G be given, 
where y G If V is a PROP and f: Q — > V is an N'^-graded set 

morphism such that f{y) = 0^(1-*^), then eval/(L) = eval/(G'). 

Proof. Let (/3, 7) : L — y G be the homeomorphism. Without loss of gener- 
ality, it may be assumed that (3{v) = v for all v G V{G) \ {0, 1}, since any L 
would be isomorphic to a network L' satisfying this condition and network 
isomorphisms preserve the value. Furthermore it is sufficient to consider the 
case that L has one vertex more than G, since the general equality is obtained 
by adding the vertices one by one. 

Let V G V{L) \ V{G) be the new vertex that had been added. Let 
Wo C V{L) be the set of inner vertices of L reachable from v via a path of 
length at least 1 (meaning v ^ Wq) and let Wi = V{G) \ Wo \ {0, 1}; then 
(Wo, Wi) is a cut in G and (Wq, {v}UWi) is a cut in L. Let Cq, ei G E{L) be 
the unique edges such that t(eo) = v = h{ei). Pick some ordering p of the cut 
{Wo,Wi) such that p (7(60)) = 1. Then [Wq, {v}UWi,po^) is an ordered cut 
in L which induces a decomposition (Lq, Li) of L. Moreover, ({f }, 1^1,^07) 
is an ordered cut in Li which induces a decomposition (Lio, Lu) where Liq = 
Nw(gjf I (^ ■ y)ei) f*^^ some list of edges f . Additionally Lq ^ Gq and Lu ~ Gi 
where (Go, Gi) is the decomposition of G induced by (Wq, Wi,p). Hence 

eval/(L) = evalj(Z/o) o evalj(Li) = evalj(Lo) o eval/(Lio) o evalj(Lii) = 
= eval/(Go) o /(y) ® 0(111^!!) o eval/(Gi) = evalj(Go) o 0(|i+llf|l) o eval/(G'i) = 

= eval/(Go) ° eval/(G'i) = eval/(G) 

as claimed. □ 
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7.3 Embeddings 

A direct translation of the abstract index subexpression concept to networks 
is thus: H is a subexpression of G if there is some K such that K ><\ H 
is a \\- subdivision of G. This is practical as a method of enumerating the 
networks G which has a given H as a subexpression, but it is not so practical 
for testing whether a specific G contains H. Luckily, there is an alternative 
characterisation in terms of networks that makes the latter straightforward. 

Definition 7.9. An embedding of a network H = {V, E', h', g', t', s', D') 
into a network G = {V, E, h, g,t, s, D) is a pair {x,'4') of maps X- ^' \ 
{0, 1} — >V\ {0, 1} and tjj : E' — > E such that: 

1. X is injective. 

2. D'^Dox- 

3. If e e E' satisfies h'{e) ^ then h{'ijj{e)) = x{h'{e)) and g{e) = g'{e). 

4. If e e E' satisfies t\e) ^ 1 then i(V'(e)) = x(i'(e)) and s(e) = s\e). 

5. If V(e) = i^if) for e,f EE' then (i) e = /, (ii) h'(e) = and t'{f) = 1, 
or (iii) t'{e) = 1 and h'{f) = 0. In cases (ii) and (iii), the legs e and / 
are said to be joined by the embedding. 

An embedding is basically that each inner vertex of H should be mapped 
injectively to an equally decorated inner vertex of G, while preserving all 
incidences from H. A convex subnetwork H oiG has a trivial embedding into 
G, where x ^"^^ both map every element in their domains to themselves. 
For testing whether H has an embedding into G, one may practically start 
by picking some vertex v oi H and merely go through all possibilities for 
xiv), i.e., those vertices of G which has the same decoration as v. Fixing 
any immediately determines ip{e) for all edges e incident with v, and 
conversely fixing iple) determines x both endpoints of e. Hence the way 
an entire component of H is embedded gets fixed after choosing just how to 
embed a single vertex, so the search tree that has to be examined is usually 
very small — much smaller than in the corresponding problem for ordinary 
graphs. 

Lemma 7.10. Let an N^- graded set and some y e ^^(1, 1) be given. If 

y 

G,H,K e Nw(Jl' \ {y}) are such that K ><\ H is a y -subdivision of G then 
there is an embedding of H into G. 
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Proof. To fix notation, let 



{Vg, Eg, hG, Qg, tG, sg, Dg) 
(Vh, Eh, hn, Qh, tn, sh, E)h) 
{Vk, Ek, hx, Qk, tx, sk, E>k) 
L = (Vl, El, hi, Ql, ti, sl, Dl) 



G, 
H, 
K, 



and let (/3,7) be the homeomorphism from L to G. Let q = oj{H) and 
r = a{H). The embedding {x, ip) of H in G is then given by 



Xiv) = (3'\r + q + 2v + 1) 
^(e) =7(2e + l) 



for veVH\ {0, 1}, 
for e e Eh, 



where r + g + 2f + 1 is known to be in the image of /3 since DL[r + q + 2v + l) = 
Dh{v) by the definition of L and Dh{v) ^ y. That x is injective is clear from 
the construction, and its compatibility with annotations follows from the 
similar properties for homeomorphisms and symmetric joins. The incidence 
conditions for e G Eh satisfying hni^e) ^ and tnie) ^ 1 respectively are 
established by chasing the commutative diagram 



tjH > 



H 



vi->-r+q+2v+l 



Ej 

hL 



-> E, 



G 



ha 



Vg 



Finally, if ip{e) = ip{f) for e ^ f then this must be because 7(2e + 1) = 
7(2/ + 1). By Lemma 01 p(7)({7(2e + 1)}) = {ei, . . . , e„} where 2 < 
hL^^i) = tLi^i+i) ^ 2 + r + g for i G [n — 1]; since 2e + 1 7^ 2/ + 1, it follows 
that n ^ 2. Having hnie) 7^ would make /iL(2e + l)>2 + r + g and thus 
imply 2e + 1 = e„, in which case 2 < tL(2e +l)^2 + r + g making tnie) = 1 
and moreover 2/ + 1 = Cj for some i < n so that 2 < /il(2/ + 1) ^2 + r + g 
and thus hnif) = 0. Similarly having tnif) 7^ 1 implies 2/ + 1 = ei, from 
which follows tnie) = 1 and hnif) = 0. Hence hnie) = and t^if) = 1, 
or tnie) = 1 and huif) = 0, which is exactly the final condition for an 
embedding. □ 

A downside with the straightforward embedding concept is that it does 
not always uniquely identify the padding K — not even up to isomorphism, 
even though it gets close. The case where it throws away information is 
that H has two or more edges directly connecting input to output, and two 
of these are mapped to the same edge in G; in this case the relative order 
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of those two isolated if-edges is not recorded in the embedding, whereas it 
would be apparent in X xi if. To remedy this, it is appropriate to introduce 
a slightly stronger kind of embedding. 

Definition 7.11. Given two networks H — {Vh, Eh, hn, Qh, ^h, sh, Dh) and 

G = {Vg, Eg, hG, Qg, tc, sg, Dg) where ^ N, a strong embedding of a 
H into G is a triplet (x, ip, m) where x- ^\{0, 1} — > Vg\{0, 1}, ip : Eh — > 
N, and m e Z+ are such that: 

1. (x, Rm o 'ip) is an embedding of H into G, where Rm '■ N — > N denotes 
the remainder function for integer division by m; Rm{k) — k mod m < 
m. 

2. is injective. 

3. e < m for all e e Eq. 

4. If e, / G Eh are such that ip{e) = ip{f) (mod m) and tnie) ^ 1 then 

5. If e, / G Eh are such that ip{e) = ip{f) (mod m) and hnie) 7^ then 

The values of ip are called segment labels, or sometimes H -segments. 

The idea is to (i) make ip injective by adding some multiple of m to the 
basic G-edge labels that it has as values and (ii) encode the relative order of 
the i7-segments within a G-edge into these multiples, so that the multiple 
increases when going from tail to head. The only conditions that have to be 
imposed are to ensure that segments that have a if-vertex at one end fall 
constitute an endpoint for the range of multiples for that G-edge; for other 
edges, every assignment of multiples actually means something. 

Lemma 7.12. Let G = {VG,EG,hG,gG,tG,SG,DG) e Nw(fi) and H = 
{Vh, Eh, hn, gH,tH, sh, Dh) G Nw(0) together with an embedding (x, "0') 
of H into G be given. Then for any m G Z+ with m > e for all e G Eg, 
there exists a strong embedding (x, ■0,m) of H into G such thatip{e) = ip'{e) 
(mod m) for all e G Eh. 

Proof. Merely take ipi^e) = ip'{e) + m9{e) for some suitable 9: Eh — > N. 
Defining E^, = p{'ip){{'ip{e)}) for e G Eh, the conditions are automatically 
fulfilled provided for example that the restriction of 6 to any Eg is injective, 
e{e) < \Ee\ for all e G Eh, e{e) = if tnie) ^ 1, and e{e) = \Eg\ - 1 if 
^if(e) 7^ 0. This is trivial to arrange. □ 
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The final result in this section is that the embedding characterisation of 
a subexpression is in fact completely equivalent to that using the symmetric 
join. 

Theorem 7.13. Let an N'^-graded set Q' and y G 1) be given. Let 

Q = Q' \ {y}. For G,H E Nw(fi), the following are equivalent: 

1. There exists an embedding of H into G. 

2. There exists a strong embedding of H into G. 

3. There exists some K G Nw(n) for which there is a y-homeomorphism 

y 

from K yi H to G. 

Proof. That[T]implies|2]is the claim of Lemma [Y.12t and that|n]implies[T]is the 

claim of Lemma 17.101 Hence what remains is to, from a given strong embed- 

y 

ding (x, m) of H into G, construct the symmetric join L = K >i H that is a 
y-sub division of G. Not surprisingly, the first step in that will be to construct 
the "padding" network K = (Vk, Ek, hx, gK,tK, sk, Dk) from the given 
data G = (Vg, Eg, Hg, gG, to, sg, Dg) and H = (Vh, Eh, hn, gn, tn, sh, Dh), 
but when digesting this construction it is more instructive to think about K 
as already a part of the symmetric join L. 

The vertices of K are simply going to be the vertices of G that are not 
in the image of the embedding, so 

= Vb \ imx and Dk = Dg\vk\{o,i}- 

The edges of K fall into four different categories, according to whether their 
head and tail in L would be vertices of K or join-vertices; an index will 
denote "even" (in K) and an index 1 will denote "odd" (joining to H). 
Edges with an odd end will have their labels derived from if-segment labels, 
whereas edges with two even ends will be labelled as in G. Let 

5=1 ipi^e) I e G Efj, with hu^e) = or t//(e) = 1 } , 
Sf,= {/GS'|/ = e (mod m) } for all e G Eg 

— then the set of even-even edges can be set up as 

Soo = { e G nhaWK) n WgWk) \S, = 0]. 

The rule for other edges is that an iZ-segment donates its label to the K- 
segment preceding it (if any), whereas a i^-segment not followed by another 
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if-segment gets as label m more than the label of the last if-segment on that 
G-edge. Hence 



Bqi = { m + max Se\e E and Se 0} , 

Bio = { min Se\e e p{tG)(yK) and Sey^ 0} , 

-^11 = U ("^e \ ^^^^ ^^^) ' 



Ek — -Boo U Bqi U BiQ U Bii. 



The label of an if-segment whose tail is attached to a vertex in G will not 
become the label of an edge in K, so Biq U Bh can be a proper subset of S. 

When defining head and head index, there are two different cases simply 
corresponding to whether the head endpoint is even or odd: 



the head index in the latter case is to make it join up with the appropriate 
input leg in H. The tail and tail index are completely analogous, but there 
it is convenient to first define a helper function for determining the if-label 
of the i7-segment preceding a X-segment: 



When showing this K is & network, the acyclicity condition is for once trivial: 
any edge endpoint that is not the same as in G is taken to be or 1 as 
appropriate, and from there a walk cannot be extended any further. It should 
on the other hand be observed that it is because of the allowed ranges for 
e in the definitions of Bqq, Bqi, and -Bio that one knows Hk and tx only 
assume values in Vk- That a combination of head and head index uniquely 
identifies an edge requires a slight case analysis. First, the combination is 
either the same as for some edge of G, or it is (0, i) for some i > uj{G); these 
two cannot overlap. In the former case it follows from unique identification 
of edges in G that a head and head index combination determines e mod m 
for e G -Boo U -Boi, and that is unique by condition on m and construction of 
-Boi. In the latter case of e G -Bio U Bu, it holds that tH{ip^^{e)) = 1 since 
if tnif) 7^ 1 for some / G Eh with = e (mod m) then the definition 
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of embedding requires ipif) to be minimal within (S'emodm and thus not an 
element of Bn, and it also places hQ{e mod m) in the image of x and thus 
outside Vk, meaning e ^ Biq. Then the value of s_f/(/) uniquely identifies an 
/ G Eh with tnif) = 1- The argument for the combination of tail and tail 
index is similar. That for each v G Vk \ {0, 1} conversely any head index up 
to a(^DK{v)) = a(^DG{v)) = d^i^v) is assumed by some e G Bqq U Bqi with 
hxi^) — V follows from considering the corresponding edge in G; it has a 
counterpart in Bqq U-Bqi- For the output vertex of K it follows by combining 
considerations for the output vertex of G and the input vertex of H, and 

again the corresponding argument for tail indices is similar. 

y 

Letting L = (Vl, El, hi, gL,tL, sl, D^) := K >i H, the claimed homeo- 
morphism {f3,j) is easy to define: 

7(2e) = e mod m for e G E^, 

7(2e + 1) = ip{e) mod m for e G Eh, 

{a{H) + u{H) + 2x~^{v) + 1 ifvGimx, 
a{H)+uj{H) + 2v iiv eVK\{0,l}, 

V ifvG{0,l}. 

Proving L to be acyclic (and thus at all a network) is another matter, but 
for this the above 7 provides a useful support. Since G is a network, there 
is a partial order Pq on Eq satisfying ei > 62 in Pq for all 61,62 G Eg 
such that tciei) = hG{e2)- Define ip: E^ — > N by ^{e) = e for even e and 
ip{e) = 2ip{^) + 1 for odd e; this so to say gives the label an edge would have 
been given in L had each edge of H been labelled ■0(e) rather than e. Denote 
the standard order on N by T and define Pl = Y^gO (a lexicographic 
composition of two pullbacks of quasi-orders) . From the claim that this Pl 
is a partial order on El satisfying 61 > 62 in Pl for all 61, 62 G El such that 
thi^i) = hL{e2), it now follows that L is acyclic and thus a network. 

The verification of this claim splits into a number of cases correspond- 
ing to the different kinds of vertices there are in L. At a vertex v — 
a{H) + cu{H) + 2u + 1, any 61 G pitL){{v}) and 62 G p(/il)({v}) are of 
the form 6j = 2/j + 1 for some /j G Eh, where tnifi) = u = /i_f/(/2). 
Then tG(7(ei)) = tG(^(/i) mod m) = x{tH{fi)) = x(m) = x{hH{f2)) = 
/ig(^/'(/2) mod m) = ^0(7(62)) and hence ei > 62 in 7*Pg. Moreover 
V — P{x{u)), so the conditions for (^, 7) to be a homeomorphism are fulfilled 
at this kind of vertex. 

At a vertex v = a{H) + oj{H) + 2u, any 61 G FI^l) ({"i^}) and 62 G 
p(/tL)({w}) satisfy 61 = 2/i for some /i G -Bqo U -Bio and 62 = 2/2 for some 
/a G SooUSoi respectively. Here, ^0(7(61)) = tcifi mod m) = tA-(/i) = = 
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^ft:(/2) = ^g(/2 mod m) = hG{j{e2)) and thus ei > 62 in YPg- Moreover 
f3{u) = V, so the homeomorphism conditions are fulfilled at this kind of vertex 
too. This latter argument also applies for v G {0, 1}, where the Pl claim is 
void as is never the tail of an edge and 1 is never the head of an edge. 

At a vertex v = 2 + i for 1 ^ i ^ Ci{H), any ei G p(tL){{v}) must 
have the form ei = 2/i + 1 for some fi G Eh with tnifi) = 1 and any 
62 G p{hi)(^{v}) must have the form 62 = 2/2 for some /2 G -Bio U Bn. 
For these two have been joined, it must be the case that gK{f2) — ^{G) = 
i = snifi), i.e., /i = ip~^{f2)- Hence 7(ei) = 7(62), which means the 
V ^ im/9 homeomorphism condition is fulfilled here, and v?(ei) = 2?/'(/i) + l > 
2/2 = 62 = V^(e2). Thus ei > 62 in P^. At a vertex v = 2 + a{H) + i for 
1^2^ uj{H), any Ci G p{tL){{v}) must have the form Ci = 2/i for some 
/i G i?oi U and any 62 G pih^) ({v}) must have the form 62 = 2/2 + 1 for 
some /2 G -E/f with hnifi) = 0. For these two have been joined, it must be 
the case that sxifi) - a{G) = i = gHif2), i.e., 9{fi) = /2. From /i = ip{f2) 
(mod m) then follows 7(ei) = /i mod m = ip{f2) mod m = 7(62), fulfilling 
the homeomorphism condition at v ^ im /3, and from ip{f2) < fi follows 
ip{ei) = 2/1 > 2?/'(/2) + 1 = ip{e2). Hence ei > 62 in Pl. 

Finally, the f G Vl \ im/3 are those with 2 < t> ^ 2 + a{H) + uj{H), and 
for these Dl{v)) = y. Hence L is a y- sub division of G. □ 

8 The free PROP 

For many readers, it was no doubt becoming obvious already in Section |5] 
that Nw(n) is the (set underlying the) free PROP generated by Q; sets of 
expressions are generally good candidates for the construction of free objects. 
Is it necessary to go through the trouble of making an explicit construction, 
though; isn't the existence and properties of this free PROP guaranteed by 
general principles of universal algebra? To some extent, they certainly are, 
but the catch here is that Nw(f2) has more structure than what follows 
immediately from the universal property, and the rewriting mechanisms will 
make explicit use of this. Theorem 17.131 links the subexpression concept to 
the symmetric join of networks, and since the elements of the free PROP are 
(isomorphism classes of) networks, there is a way to define symmetric joins 
also of elements of Nw(f2), even though this operation will have to be subject 
to some restrictions of a mostly syntactical nature. Therefore, it turns out 
that the family of modules on which one wants to apply the diamond lemma 
is not that of the components of the free PROP, but a B*^ '-filtration of the 
free PROP! 

A great help when putting forth Nw(fi) as the free PROP generated by Q 
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is that the extension of an arbitrary N^-graded set morphism / : Q — > V to 
a homo morphism Nw(f2) — > V required by the universal property is aheady 
known: it is the map eval/. It has however not been shown yet that this map 
is a PROP homomorphism, nor for that matter that Nw(fi) is a PROP or even 
what its operations are (even though Theorems 14.81 14.10[ and 15.171 provide 
strong hints)! For the latter points, one may preferably turn to Theorem 15. 131 
as there is a natural choice of evaluation map L: Nw(Nw(n)) — )■ Nw(f2). 
A practical construction of it is the bottom row in the commutative diagram 



Nw(Nw(^])) 



flatten t.-, /^;\ smoothen /r^\ 

> Nw(fi ) Nw(i7) 



Nw(c) 



Nw(Nw(^])) V Nw(fi') 



M 



Nw(^]) 



where VL' = QU {\]}, the vertical c and c' arrows map an element of Nw(fi) 
and Nw(n') respectively to its equivalence class in the corresponding Nw, 
and Nw(c) applies c to each annotation of a network. The flattening map 
takes the inner networks found in the outer network annotations, splits the 
and 1 vertices of each annotation into separate vertices for each input and 
output (these new vertices get the distinct annotation \\ G fl' \fl, which 
has arity and coarity 1), and joins it all up with the edges from the outer 
network. Then the smoothening map removes these \] vertices, joining the 
incident edges with each other. Thus one goes 



from G 




via H 




to K 




when evaluating a network of networks. Smoothening can also be handy in 
defining the symmetric join, but more on that after the PROP structure of 
Nw(r2) has been established. 
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8.1 Formal construction of PROP structure 

From now on, since many networks will be considered simultaneously, the 
various data defining a network will be denoted by their symbols in the 
definition {V, E, h, g, t, s, and D) subscripted with the symbol of the 
network (typically G, H, K, or Dq{u) for some vertex -u of G). Beginning 
with the smoothening map, one has to consider how some H G Nw(O') is 
mapped to the corresponding K = smoothen(i^) G Nw(r2). Clearly, 

VK^VH\{veVH\D{v)^^}, 
Dk — -Dij|vK\{o,i} 

and one may choose 

EK^{eeEH\ t{e) G Vk } 
after which it is natural to take 



tK — ^hIek — sh\eh 

For the head ends, it is convenient to first define 



S{e) 



e if hnie) = 0, 

e if hnie) > 1 and DH{hH{e)) 7^ \\, 

S{f), where / G Eh is such 

that tnif) = hnie) otherwise. 



for all e G Eh, since then S{e) is the headmost edge on the path in H 
beginning with e and only having t] inner vertices; this is well-defined since 
H is acyclic. Given S, the remaining maps are trivially defined as 

hxie) = hH{S{e)) and gxie) = gH{S{e)) for all e G -Ex. 

The completes the definition of the smoothening map for labelled networks. 
In order to see that the unlabelled counterpart M exists, it suffices to observe 
that S can be pushed forward across isomorphisms (the property of being the 
headmost edge does not depend on the labelling). It should also be observed 
that (id, S) is a homeomorphism from H to smoothen(iJ) ~ K. 

When concretely constructing the fiattening map from Nw(Nw(Q)) to 
Nw(n'), one should first observe that there is both an inner and an outer 
level of networks in the domain of this map; the inner networks (which are 
networks of Vl) appear as annotations in the outer network (which is a network 
of Nw(Q)) that the map is defined for. Since the idea is to combine all these 
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networks into one, the following construction employs an injection p : — > 
N, namely p{i,j) = (i + j)^ + i, to avoid collisions when assigning labels in 
the fiat result. An edge e in the outer network will become edge p{l,e) in 
the result, whereas an edge e in the inner network decorating vertex u will 
become edge p{u,e). An inner vertex v in the network decorating vertex u 
will become vertex p{u, v), whereas the t| vertices will have labels on the forms 
p{i,p{u,j)^, where i e {0, 1} depends on whether they were made from an 
output or input, and j is the corresponding head or tail index. Finally, the 
outer output and input vertices retain the labels and 1; these do not collide 
with the aforementioned since p{i,j) G {0, 1} implies i = and j G {0, 1}, 
while 14 ^ 2 in all cases where these formulae are applied. 

Given G e Nw(Nw(Q)), the flattened form of G is thus the network H, 
where 

Vh = {0, 1} U U Wu, 

ueVa 

Wu= {p{u,v)\veVnaiu)\{OA}} for«e Vg\{0,1}, 

Wo^ {p{0,p{u,j))\ueVG\{0,l},je [dUu)]}, 
Wi = j)) I M e \ {0, 1}, J e [daiu)] } , 

Eh = [J Fu, 

ueVa\{0} 

Fi= {pil,e)\eeEG}, 

Fu = { p{u, e)\ee Eoaiu) } for m G Vb \ {0, 1}. 
For any ti e Vg \ {0, 1} and e e Edq{u) (i-e., for any inner edge), 

^p{u,hDG{u){e)),gDG{u){e)^ if hDG{u){e) 7^ 0, 
^p{0,p{u, gDa(u) (e)) ) , 1) Otherwise, 

[p{u,tDGiu)ie)) , SDG(u){e)j iitDG{u){e) 7^ 1, 
^p{l,p{u, S£,g(„)(e))), 1) otherwise. 

For any e e Eg (i.e., any outer edge), 

{0,gG{e)) if/iG(e) = 0, 

p{l,p{hG{e),gG{e))),l) otherwise. 



{hH,gH){p{u,e)) 
{tH,SH){p{u,e)) 



(hH,gH){p('i-,e)) = 
{tH,SHmi,e))- |(^^(o,p(^^(e),.^(e))),l) otherwise. 
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Lastly 

DMu,v)) = l''^^^-^^''^ if «^ {0,1}, 
I t] otherwise 

for all u E Vg and f G N such that p{u,v) G Vh- That H so defined fulfils 
axioms [2], [31 and H] of Definition EU] is a direct consequence of G and the inner 
networks meeting these conditions, since they are all about local conditions 
which for non-t] vertices are preserved by the fiattening map and for \] vertices 
are trivial. The acyclicity axiom [1] is not local, but still easy to verify; an 
oriented cycle in H either contains some edge e) for e G Eq, and than the 
set of such edges would constitute an oriented cycle in G thus contradicting 
its acyclicity, or it only contains edges on the form p{u, e) for some fixed u, 
and then it contradicts the acyclicity of Dg{u). 

Finally, there is the matter of whether there exists some map F which 
makes the left square in the commutative diagram commute. Since the ef- 
fect of the vertical maps is to replace networks with equivalence classes of 
same, what needs to be shown is that fiatten maps isomorphic elements in 
the domain to isomorphic elements in the codomain, or more precisely that 
there are isomorphisms of the fiattened network that correspond to isomor- 
phisms of the inner networks; only edges and vertices corresponding to edges 
and vertices of some inner network may be affected by the class of isomor- 
phism considered. By definition, an isomorphism is just a relabelling, and 
the deterministic construction of the fiattening map is such that one can read 
off the pre-flattening labels from the flattened labels. Hence the construc- 
tion of a corresponding isomorphism of the flattened target merely consists 
of: compute pre-flattening inner label of the edge or vertex, map it using 
the isomorphism corresponding to the outer vertex it is part of, and then 
compute the new post-flattening label. Thus the map F is well-deflned. 

Lemma 8.1. Let L = FoM : Nw(Nw((])) — > Nw(fi) as described by (l83]) . 
If G E Nw(Nw(r2)) has a split or cut decomposition {Go,Gi), then there is 
in each K G L[G) a split or cut respective decomposition {Kq^Ki) such that 
Ko G L{Go) andKi G L(G'i). 

Proof. Let if be a counterpart of G in Nw(Nw(r2)), i.e., choose Duiu) G 
Dg{u) for every ueVg\ {0, 1} and deflne H = (Vg, Eg, Hg, Qg, to, sg, F>h)- 
Let H' G F{G) be the flattening of H and let H" G L{G) be the smoothening 
of H'. Observe that split and cut decompositions are graphic properties 
independent of the labelling, so it is sufficient to exhibit a decomposition of 
one element of L{G) (namely H") whose parts satisfy the wanted conditions. 

Suppose (Fi, Fr, W\, W^) is a split in G inducing the decomposition (Gi, G^)- 
A split in G is also a split in H; let {Hi, H^) be the induced decomposition 
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of H. Splits survive flattening; there is a corresponding split (F/, F/, W^) 
in H' , namely 

Fi = {p(l,e) e I e e Fi } U [p{u,e) e F^' | « G } , 
F; = {p(l,e) e Fj^, I e e Fr } U |p(ii,e) e F^^, | e W^r } , 

Ty/ = { f ) g Vff/ 1 m g Wi } u I G Vff/ 1 M G w^i I , 
w;' = {pK G Vff. I H G } u j)) G I K G ly, } . 

Let {H[, H'^) be the induced decomposition of H' . Since flattening only con- 
siders local properties of networks, it follows that Hi flattens to H[ and H,. 
flattens to H'^. 

Splits also survive smoothening, and the corresponding split in H" is 
(F/', F/', Wl\ Wi') where F/' = F{nEH", F," = F^DEh", W{' = WIhYh", and 

= W^DVh"- The locahty of the smoothening map definition again implies 
that the smoothenings H" and H" of H{ and respectively are precisely 
the parts of the decomposition {H^', H^') induced by (F/', F/', W{', W^'). Since 
Nw(c)(i/i) = Gi and Nw{c){H,) = G,, it follows that H{' G L(G'i) and 

G L{Gr). 

For a cut decomposition (Gq^Gi) of G, one similarly observes that the 
ordered cut {Wo, Wi, q) inducing it is also an ordered cut in H. The flattening 
H' has the ordered cut (VF2, W3, g'23) where 



ueWn 



W2 = {piu,v) eVH'\ueWo} u \^p{i,p{u,j)) G 
W3 = eVH'\ueWi}u [p{i,p{u,j)) g V^/ 1 g W^i } , 

523(^(1, e)) = q{e) for cut edges e G Fi^. 



The corresponding ordered cut in H" is W5, 545), where W4 = 14^2 nV^", 
= M/an Vf///, and q^l = Toq~^, where T: Eh' — > Eh" is the map which 
satisfies T{e) = e for e G Eh' such that tn'ie) G Vh" and T(e) = T[f{e)) for 
other e G Eh', where /(e) G Eh' is the unique edge such that hH'{f{e)) — 
tH'{e). 

Let {Hq,Hi) be the cut decomposition of H induced by (Wo,Wi,q), let 
{Hq,H[) be the cut decomposition of H' induced by (VF2, 1'^^s, fe), and let 
(i?o , H") be the cut decomposition of H" induced by (W4, W^, ^45). As in the 
split case, Hq and Hi flatten to H'^ and H[ respectively, and H[ smoothens to 
but Hq smoothens to some H'qq which is usually not the same as Hq \ the 
cut edges of H' survive smoothening in H'q as they there have the non-t] tail 
1, whereas a cut edge in H' would only have a non-t| tail if its counterpart in 
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G had 1 as taiL Hqq and H'q are however isomorphic, with the isomorphism 
Hqq — > Hq being the identity map on vertices and the map T on edges. 
Hence H'^ G L{Gq) and H'l G L{Gi). □ 

Theorem 8.2. For any W'-graded set Vl, the set Nw(f2) is a PROP with 
evaluation L as described above, composition as defined by (15. lip . and tensor 
product as defined by fl5.12p . 

Proof. The idea of the proof is simply to verify the conditions of Theo- 
rem [5]T3l The first condition is that L must be invariant under isomorphisms 
of the outer network (isomorphisms of inner networks figured already in the 
definition of L). Let Gi,G2 G Nw (Nw(f2)) such that Gi ~ G2 be arbitrary; 
let (x, ^j) '■ Gi — )■ G2 be the isomorphism. Define D' : VcAjO, 1} — > Nw(i7) 
by picking as D'{v) some element of Dg^{v). Define 

G\ = {VG„EG,,hG„9G,,tG,,SG,,D') G Nw(Nw(r])), 

G'2 = {VG„EG„hG„gG„tG„SG„D'ox-') G Nw(Nw(fi)). 

Since Gi and G2 are the images of G'l and G'2 respectively under the Nw(c) 
map of the commutative diagram (18.11) . it will follow that F{Gi) = F{G2) 
(and hence L{Gi) = L{G2)) once it has been shown that the flattenings of 
G'^ and G^ are isomorphic. 

Let H[ and Hi^ be the flattenings of G'^ and G^ respectively. Then the 
isomorphism (%', ip') : H[ — > H2 is given by 

X'{p{u,v)) =p[x{u),v) 
x'(p{0,Piu,j))) = P[0,p{xiu),j) 



X'(p{l,piu,k))) = p(l,p{x{u),k) 



for all V G Vd'(u) \ {0, 1}, j G [rf+^(M)], k G [dG^{u)], and uEVgA {0, 1} on 
one hand, and by 

iP'{p{l,e))=p{l,^{e)), 

=p{x{u)J) 

for all e G Eg^, f G E£)^^(^u), and u G Vg-^ \ {0, 1} on the other. 

Next consider the composition condition: that L{G) = L{Go) oL{Gi) for 
every cut decomposition (Gq? Gi) of G. By Lemma 18.11 every K G L{G) 
has a cut decomposition {Kq^Ki) such that Kq G L{Gq) and Ki G L{Gi). 
Hence to exhibit a representative of L{Go) o L{Gi), one may first let H = 
Nw(p|(2: Ko)U^: K,)^) where 1 = N,(i^)(0,3), m = N^(^,)(l,3), and 
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n = Nq,(;^)(2, 3). Taking H' to be the flattening of H and H" to be the 
smoothening of if', the problem reduces to that of showing K ~ H" . Let 
(Wo,W^i) be the cut in K that induces {Kq^Ki). Then the sought isomor- 
phism (x, if)) : K — )■ H" is 

if {0,1}, 

X{.v) = { p(2, v) ifv e Wo, for v e 1/?^, 

if G VTi 

if tK{e)eWo, 

^{e) = { p(3, e) if t,^(e) G VTi, for e G Ek] 

Xh^sM-l) ift;^(e) = l 

an edge of K may have up to five counterparts in H', but the one that 
survives smoothening is that whose tail is at a non-^ vertex. 

Third consider the tensor product condition: that L{G) = L{G2)® L{G^) 
for every split decomposition {G21 G^) of G. By Lemma ISTTj every K G L{G) 
has a split decomposition (^^'25 -^3) such that K2 G L{G2) and K-^ G L{G^). 
Hence to exhibit a representative of L{G2) L{G3), one may first let H = 
Nw(J,"^| (2: ^2)^(3: K,)^) where k = N^^,)(0,2), 1 = N,(^,)(l,2), m = 
N^(X3)(2w(i^2),2), and n = N„(X3) (2a(i\:2) + 1,2). Taking H' to be the 
flattening of H and H" to be the smoothening of H', the problem reduces to 
that of showing K ~ H". Let (F2, F3, 1^2, W^s) be the split in K that induces 
{K2, K^). Then the sought isomorphism (x, ^z^) : K — y H" is 

if {0,1}, 

if f G W2, for w G V/^, 

if f G 1^3 

if t;^(e)GW^2, 

if ti^(e) G 1^3, for e G Ej^. 




p(l,2sx(e)-l) ifti,(e) = l 



Finally consider the elementary network condition: that given any 7 G 

N^(fi), it holds that i^(Nw(;^ | 7^)) = 7 for m = N^(^)(0,2) and n = 

NQ,(-y)(l, 2). Pick some G G 7 and let K G Nw(fi) be the result of flattening 
and smoothening Nw(j^ | (2: G)™). The claim is then that G 7, or equiv- 
alently that G ~ i^'. Since all inner vertices of K are images under flattening 
of inner vertices in G, and similarly all edges in K except those with tail 1 
are images under flattening of edges in G, it turns out that this isomorphism 
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(x, ^) : G — > K can be expressed as 

= < , , for all e Vg, 

lp(2,f) otherwise 

.^,(,) Jp(1.2M^)-l) iffcW = l. fo,^,,,^^. 

I p(2, e) otherwise 

□ 

The next order of business is the universal property. 

Lemma 8.3. Let an 'H'^-graded set Vt, a PROP V , and an N'^-graded set 
morphism f : Q — > V he given. If i: fl — > Nw(f2) is the N'^-graded set 
morphism satisfying 



^rlllaS) for "llx^n (8.2) 



then eval/: Nw(fi) — > V is a PROP homomorphism satisfying eval/ oi = f. 

Proof. To begin with, a PROP homomorphism must preserve composition. 
To that end, let l,m,n G N, (3 G Nw(fi)(/,m), and 7 G Nw(r2) (m,n) be 
arbitrary. Pick some Gq E P and Gi G 7. Let 



xNK0,3) nN„(1,3) 
>^'-'0Jn,„(1,3)>^'-'1^N„(2,3) 



Let H be the flattening of G and be the smoothening of H. Then ii' G /307. 
Let f (x) = /(x) for x G and /'(^) = then 

eval/(/3 07)= eval/(-ft') = eval/'(//) 



by Lemma 17.81 since if is a t]-subdivision of K. H has an ordered cut 
{Wq, Wi,q) where 



Wo = {p(0,p(2, j)) } . U {p(l,p(2, j)) } . ^ U M2,t;)}^^^^ : 



W^i= p(0,p(3,j)) . ^ U p(l,p(3,j)) . ^ U{p(3,t;)} , 

Q'^U) = 3j - 2) for j G [m]. 

The corresponding decomposition {Hq, Hi) is such that Hq is a t]-subdivision 
of Go and Hi is a t]-subdivision of Gi. Hence 

eval// (if) = eval//(ifo) oeval//(/fi) = 

= eval/(Go) o eval/((j'i) = eval/(/3) o eval/(7) 
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and thus eval/(/3 07)= eval/ /3 o eval/ 7. 

Next consider the tensor product: let k, 1, 171,11 G N, (3 G Nw{Q){k,l), 
and 7 G Nw(fi)(m, n) be arbitrary. Pick some Gi G /3 and Gr G 7. Let 

and i^' be the smoothening of H. Then i^' G /3 ® 7. Let /X^^) = for 
X G f2 and /'(t]) = 0^(1"'^); then by Lemma [7. 8[ 

eval/(/3 07)= eval/(-ft') = eval/'(iJ). 

if has a spht (Fi, Fr, PVi, W^) where 

= {p(l,4j - 4)}^.^j,j U {p(l,4j - 3)}^.^j^j U {P(2,e)}^^^^^, 
= {pilAj - 2)}^.,(„, U {Ml,4j - U {P(3,e)}^^^^^, 

The corresponding decomposition {H\, H^) is such that Hi is a [^-subdivision 
of G\ and i^r is a ^-subdivision of Gr. Hence 

eval//(if) = evalf/{Hi) (g) eval//(//r) = 

= eval/(Gi) ® eval/(Gi.) = eval/(/3) ® eval/(7) 

and thus eval/(/9 ® 7) = eval/ /3 ® eval/ 7. 

Third consider permutations: let n G N and a G Sn be arbitrary. Then 



eval/ (a)) = eval^ (({0, 1}, [n], 0, a, 1, T, 0) 



N„(l,l) 

a-i(l)---o-i(n) 



J V 



since N„(l, 1) = a<^(i) ■ ■ ■ a<^(„) if = a ^(j) for all j G [ra]. 

Finally consider the map i: let a; G f2 be arbitrary. Let m = Nt^(a.)(0,2) 
and n = Nq,(j,.)(1, 2). Then 

eval^(z(x)) = eval;(Nw(j; | x^)) = [I, \ f{x)^]^ = f{x), 

as claimed. □ 
Theorem 8.4. Nw(^]) is the free PROP on Q. 
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Proof. Lemma 18.31 already states that any N^-graded set map / : Q — > V 
for a PROP V extends to a PROP homomorphism eval/: Nw(r2) — > V, so 
what remains to show is that this homomorphism is unique; with i as in the 
lemma, it must be shown that (fioi = f = (f2oi for PROP homomorphisms 
(fi, (p2 ■ Nw(i7) — > V implies ipi = ip2- 

Let 7 G Nw(fi) and G G 7 be arbitrary. The proof is by induction on 
the number of vertices in G. If G has two vertices (i.e., no inner vertices) 
then 7 = for some permutation a and ^pi{'y) = (0Nw{n)('^)) = 

(f)'p{a) = V52(0i^(Q)(o-)) = V2{l)- If G has three vertices then Vq = {0, 
meaning (0, {f }) and ({f},0) are cuts in G. Defining a = e^(0), b = 
6^(1;), c = e^(f ), and d = e^(l), one may utihse these cuts to produce the 
decomposition 

7=e^/^Ml]o.(Z^c(.))®K|l]oE(./,)|l]. 

Since ipi[i{x)) = ip2{i{x)) for all a; G ^2, it again follows that (pii^j) = ^P2{l)- 
Finally consider the case that n := IVgI > 3, and assume (pi and ip2 
coincide for all networks with less than n vertices. Let v be an inner vertex 
of G whose out-neighbours are all in {0}. Then {{v}, Vg \ {0, 1, v}) is a cut 
in G; let (Go,Gi) be a corresponding decomposition. Then 7 = evalj(Go) o 
evalj(Gi) and hence 

'fiil) = V5i(evali(Go) oevali(Gi)) = (evalj(Go)) o t^^i (evali(Gi)) = 
= v52(evali(Go)) o v92(evali(Gi)) = v92(evali(Go) o evali(Gi)) = ^2il)- 

It follows that v^i(7) = ^2(1) for all 7 G Nw(fi). □ 

With the free PROP properly established, it is next time to sort out the 
free 7^-linear PROP. It seems appropriate to follow the suite of TZ{X), TZ[X], 
and TZi^X) in a basic notation for this with 7^{X}, as braces are the simplest 
delimiters not yet appropriated, and furthermore the "spurs" on the braces 
suggest the possibility (as in networks) of external connections. 

Definition 8.5. Let TZ be an associative and commutative ring with unit. 
Let VL be an N^-graded set. Then the free 7^-linear PROP on Vt is denoted 
n{VL}. 

Corollary 8.6. 1Z{Vl] is the same as TZNw{Q). In particular, Nw(f2) may 
be regarded as a subset of TZ{Q} and Nw(f2) (m,n) is a basis of the TZ-module 
7^{f2}(m,n), for all m,n E N. Similarly, any x E Q may be identified with 

the isomorphism class 0/ Nw(J^"|''|^q 2) | ^^^"["'^(i 2)) Nw(i7). 
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Proof. Merely combine Theorem 18.41 with Construction I2.13[ 



□ 



Remark. When using network notation for elements in TZ{Q}, it can be a 
good idea to surround each network with a bracket, as in 




There are two reasons for this. One, being more theoretical, is that the 
elements of the PROP Nw(f2) are isomorphism classes of networks whereas 
the diagrams themselves are concrete networks, so the brackets are "needed" 
to make it a notation for an element of the PROP. The other reason, of a 
more practical nature, is that they improve legibility; when networks become 
part of a greater formula in more traditional notation, it can be hard to tell 
exactly where the boundaries of one network are. Delimiters that are placed 
around a network solve this problem, by visually becoming a frame. 

It may also be observed that 7^[X] and 'R-{X) both arise as special cases of 
71{X}, for suitable choices of arity and coarity for the generators: if a{x) = 
uj{x) = for all X G X then 7^{X}(0, 0) ^ 7^[X], and if a{x) = uj{x) = 1 for 
all X e X then 7^{X}(1, 1) = 7^(X). 

8.2 The symmetric join 

So far, this section has delt with establishing that this concrete construction 
of the free PROP from networks satisfy the basic category-theoretical prop- 
erties required of a free object. That focus will now shift towards properties 
that are not so basic from a categorical perspective — to categorically de- 
fine for example a PROP filtration seems to require climbing a step or two 
on the abstraction ladder — but remain perfectly basic from the more naive 
perspective of classical abstract algebra. The first order of business is to 
define the symmetric join in the free PROP, so that one can get a free PROP 
characterisation of the subexpression concept of Section [71 

Lemma 8.7. Let Q be an N'^-graded set and z G 1) be arbitrary. Let 
H, H', K, K' e Nw(fi') and r,q eN be such that K H and K' H' are 
networks. If (/3o)7o) is a homeomorphism from K' to K and (/3i,7i) is a 

z 

homeomorphism from H' to H , then a homeomorphism from K' H' to 
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K W^H is (/3,7), where 

/3(f) = V ifv^2 + r + q, 

(3ir + q + 2v) = r + q + 2f3o{v) iIvEVkX {0, 1}, 

(5{r + q + 2v + l) = r + q + 2(5i{v) + l if v E Vh\{0,1}, 

7(2e) = 270(e) ifeeEK', 

7(2e + l) = 271(e) + 1 ifeeEn'. 

z z 

Conversely, if (/3,7) is a homeomorphism from K' H' to K H such 
that P{v) = V for v — 2 E [r + q] and /3(f) = v (mod 2) for all v G V^^^^, 

then there is a homeomorphism (/3o,7o) from K' to K and a homeomorphism 
(/3i,7i) from H' to H satisfying 

7o(e) = \l{2e) for eE Ek', 

71(e) = i(7(2e + l)-l) foreeEH', 

/3o(f ) = i(/3(r + g + 2f ) - r - g) forvEVK\ {0, 1}, 

Pii^) = li^r + g + 2f + 1) - r - g - 1) forvEVnMO, 1}. 

Proof. Merely verify that the constructed pairs of maps satisfy the conditions 
for being homeomorphisms. □ 

A special case of the above lemma is that if K c:^ K' and H c:^ H' then 
Km^^H ^ K' W^H' because an isomorphism is an invertible homeomorphism. 
Hence the symmetric join can be defined as an operation on Nw(f2) too. 

Definition 8.8. Let Vt be an N^-graded set with t] ^ ^ and TZ be an associa- 
tive and commutative ring with unit. The symmetric join on Nw(f2) is 
defined by 

[K]^ [H]:^ := [smoothen(ir /7)]^ (8.3) 

for all K,H E Nw(f2) such that the right hand side exists. The symmetric 
join operation is extended to TZ{Q} by bilinearity. In both cases, the right 
annexation a x 6 is defined as a n"?| b. 

The next lemma extends the subexpression characterisations of Theo- 
rem [7]T3] with a claim purely in terms of elements of the free PROP. 

Lemma 8.9. Let Q be an N'^-graded set with \\ ^ Vt. Let networks G,H,K E 
Nw(i7) and r, g G N such that K n'^^H is a network be given. Then [G\^ = 
[K]^ [H]^ if and only if K \a'^^H is a \\- subdivision of G. 
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Proof. There is always a t]-homeomorphism (id, smoothen) from K H to 
G' := smoothen(i\: i/). If [G]^ = [fsT]^ [i/]^, then there is by defi- 
nition of N an isomorphism from G' to G, and this can be composed with 
(id, smoothen) to yield the necessary homeomorphism from K \A^^H to G. If 
conversely there is a t]-homeomorphism from to G, then G ~ G' by 

Lemma 17. 7[ □ 



The definition makes it clear how to compute the symmetric join of two 
explicitly given networks, but it is less clear how one might compute it for 
more abstract expressions. It turns out, however, that the abstract index 
notation makes a good match with the symmetric join. 

Theorem 8.10. Let Vt he an N"^ -graded set with \\ ^ Q. Let TZ he an as- 
sociative and commutative unital ring. Let {ai}l^i, {hjYj^^ C 1Z{VL) he ar- 
hitrary. Let {kjjf^Q, {lijf^g, {nijj^^Q, and {njj^^Q he lists of lahels. Let q 
and r he lists such that 
(U'=o|m,l). Th 



(Ulo|ld)\(Ulo|k.|) «nrf|q| = (U;=o|n,l)\ 



en 



lono 
komo 



loq 

kor 



i=l 



^k. 



N 



rno 
qmo 



■4) 



— that is to say: if the lahel lists are such that the ahstract index expression 
in the left hand side is defined, then the right hand side is defined too, and 
the two expressions are equal. 



Proof. By Lemma I4.15[ abstract index expressions are multilinear, and the 
symmetric join is bilinear by definition. Hence it is sufficient to verify (18. 4p 
for {aj}f=i, C Nw(n). By Theorem 14. 1 1 1 any bijective relabelling of an 

abstract index expression is equivalent to the original one, so it can without 
loss of generality be assumed that all the labels are natural numbers, so that 



G = Nw 

' komo 



i=l 



i=l 



■J 

JJmj I 5 



i=i 



H 



Nw ( "1"° 

' ' rmo 



are elements of Nw(Nw(fi)). That the expressions for K and H, as well as 
their counterparts in (18. 4p . fulfill the arity and acyclicity conditions is imme- 
diate from the fact that they are fulfilled for G, but the matching condition 
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depends on the way q and r were chosen, 
fills the matching condition, [Ji=o '-'U/= 
these unions are disjoint. Hence 



Since the expression for G ful- 



|m,| = ULo|l^|UU 



J 

j=0 



Ujl, and 



r\ = (U \ (U |k,l) = (U 11.1 U U |„,|) \ (U |k.| U U In 

U |k,| U U |m,|) \ (U |k,| U U |n,|) = (U |m,|) \ (\J |n,|) 



S=0 j=0 



meaning 

J/ 



|r| is the half of the symmetric difference between lJj=o 



and 



U;=o 



which is not in q, and thus the expression for H fulfills the matching 
condition. Similarly one sees that q is the part of the symmetric difference 

between IJi=o 1^*1 Ui=o 1^*1 ^^^^ 

The left hand side of (18.41) is by (15. 2p equal to eval(G), and likewise 
eval(-ft') and eval(if) are equal to the two abstract index expressions in the 
right hand side of (18.41) . Hence what needs to be shown is that eval(G) = 
eval(i^') N jj^'i'i eval(if ). Since the symmetric join on Nw(f2) is defined in terms 
of the symmetric join on Nw(n), a way to establish that equality is to exhibit 
G' e evaKG), K' e eval{K), and H' G eval{H) such that G' and K' xj^J H' 
have a common t]-subdivision. Pick some Ki & ai for i = 1, I and Hj G bj 
for j = 1, . . . , J. Let 



G" = Nwf !°"° 



1=1 



m, I 5 



H" = Nw 

' qmo 



i=l 
J 



■J 



Clearly G", K" , H" G Nw(Nw(fi)) . Keeping in mind that eval on Nw(Nw(fi)) 
is also defined by (18. ip . it follows that the smoothenings of the fiattenings of 
G", K" , and H" are elements of eval(G), eval(i^'), and eval(if) respectively, 
whence these smoothenings of fiattenings are candidates for being the G', 
K' , and H' described above. 

As for subdivisions, it is easy to see that defining 



m 



+ 
+ 



+ 2v 
+ 2{y 



ift;G{0,l}, 
if t; - 1 G [/], 

liv-l -le [J], 
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7(2e) = e if e G E^", 

7(2e + 1) = e if e e Eh" 

makes 7) a t]-homeomorphism from K" N H" to G". Hence there is also 
a ditto homeomorphism from the flattening of the former to the flattening 
of the latter, and thus the flattening of K" txijj^|| H" is the sought common 
tj-subdivision. □ 

Having the ability to put a generic abstract index expression back togeter 
from an arbitrary bipartition of it makes the symmetric join a very versatile 
operation; one recipe for expressing something as a symmetric join is to first 
express it as an abstract index expression and then collect the individual 
factors into separate operands of the symmetric join. For example, one can 
use this to show that a o 6 o c = [^\ afb\^c^] = | afc^] n ^ff | b\^] = 
(a ® c o 0(ll"llxll^l')) X b for appropriate label lists k, 1, m, and n. 

Corollary 8.11. Let Q be an N'^-graded set with \\ ^ Vt. Let TZ be an associa- 
tive and commutative unital ring. The following hold for any k, l,m,n G N; 

1. a^b = a iA^b for all a e K{Vt]{k, I) and b G K{Vt]{m, n). 

2. aiA%^b = aob = b'tA'Q a for all a ^ TZ{Vt]{l,m) and b G TZ{Vt]{m,n). 

3. a ^('"X") = a = 4>{^X'') ^{a for all a G 7^{fi}(A; + m, / + n). 

Proof Letting k = Nfc(0,4), 1 = Ni(l,4), m = N„(2,4), and n = N„(3,4), 
all these identities follow from Theorem 18.101 for suitable choices of q and r. 
Taking both empty and employing Theorem 14.101 one gets 

a^b=\l\a^]^['^\b^] = [jr^|aM = [L | «i ] <['L\b^]=^<b. 

Taking q = m and r empty gives 

aob=[^\alb^] = [Y'lal] [^\b^]=aMlb, 

whereas taking r = m and q empty gives 

Taking q = n and r = m gives 

^ rln I ^kml rln I ^kml . . m fmn I -r 1 ^ k^ti ±rm\/n\ 
« = [km I «ln J = [km I «ln J [nm | IJ = « N„ 0( X ) 

whereas taking q = k and r = 1 gives 

« = [km I = [Li I 1] xL [km I = ^('X'^) nL a. 

□ 
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The symmetric join formulae for (g) and o above suggest that an alternative 
approach to introducing the PROP structure on Nw(n) would be to start 
with the symmetric join and then use these formulae to define the ® and 
o operations. The kind of associativity that Lemma 17.21 establishes for the 
symmetric join gives both 

(aob) o c = (aN°6) ixi^c = aN°(6ixi^c) = a o [b o c) 

and 

(a®6)(8)c=(aixio6)NgC = aNg(6Ngc) = a(g)(6(g)c). 

Similarly Lemma 17.31 contains the bulk of the tensor permutation axiom for 
PROPs and item [3] of the corollary has the tensor and permutation identity 
axioms as special cases. 

A disadvantage of the symmetric join as defined so far, which would be 
more pronounced if seeking to use it as the primitive operation in the free 
PROP, is that it is a partial operation not necessarily defined for every pair of 
operands. It is however possible to distinguish fairly large subsets of Nw(f2) 
on which one can predict that a certain symmetric join is always defined; 
knowing this should help reduce any worries one might have about strange 
corner cases in the extension to TZ{Q} of the symmetric join. As it turns out, 
the subsets where n is predictably defined constitute a filtration. 

Lemma 8.12. Let V and Q he PROPs, let f : V — > Q he a PROP homo- 
morphism, and let Q he a PROP quasi-order on Q. Then the family {FgjggQ 
of subsets ofV defined by 

F, = {aeV\ f{a) ^ g in Q } for all q e Q (8.5) 

if a {Q,Q) -filtration ofV. 

Proof. What must be done is to verify the conditions from Definition 16.121 
That Fq C V[uj{q), a{q)) is because /(a) ^ q in Q implies uj{a) = uj[f{a)) = 
uj{q) and a(a) = a (/(a)) = a{q) by definition of N^-graded set morphism / 
and quasi-order Q. That Fq F^ ii q ^ r in Q follows from the transitivity 
of Q via 

a E Fq /(a) ^ q in Q =^ f{a) ^ r in Q <^==^ a G F^. 

For a E Fq and b G Fj. one finds that 

/(a (g) 6) = /(a) ® fib) ^q®r, 
f{aob) = f{a) o fib) ^qor. 

For any permutation a, /(0p(cr)) = 0Q(cr) ^ 0q(c") in Q and thus 0-p(cr) G 
F(f>Q{u)- Finally it is a filtration of V since any a G P belongs to -^/(o)- CH 
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Definition 8.13. Let an N^-graded set Q and an associative and commuta- 
tive ring TZ with unit be given. For every A G B*^*, let 



(8.6) 
(8.7) 



y^{A) := I a G {u{A), a{A)) Trf (a) ^ A 

Mn{A) := Span{yn{A)) cn{n}{co{A),a{A)). 



In contexts where the signature Q is fixed, the subscript may be omitted 
from yn and Mn. 



Corollary 8.14. {yn{A)} 
is an TZ-linear filtration ofTZ{VL}. 



IS a 



filtration oflSiw{n). {Mn{A)} 



AeB* 



Proof. For y, this follows immediately from Lemma [8. 121 by taking the trans- 
ference Trf : Nw(fi) — t- B*^* as the homomorphism; that Trf is a homomor- 
phism was the subject of Lemma [6. 151 For Ai, this follows from the linearity 
of o and ® on 7l{^l}. □ 



Remark. If k,l,m,n,r,q G N, An G B'^^', A12 G B'^^'?, A21 G B^^', A22 G 
B'■^^ B22 e B'?^'', B23 G B^^", B32 e B^^^ and ^33 G B™^'^ are such that 
A22B22 is nilpotent, then the symmetric join gives rise to maps 



All A12 
A21 A22 

All A12 
A21 A22 



B22 B23 

Bs2 -B33 

B22 B23 

B32 -B33 



yn 



where 



C3I •— B32{A22B22)* A21, 



33 



5. 



33 



Cii 


Cl3 


C31 


C33_ 


'Cii 


Cl3 


C31 


C33 


^23, 




B22) 


*A22l 



A variation on this observation, where one keeps the left factor fixed, is the 
core of Definition 110. 1[ 

The symmetric join moreover has some factorisation properties that are 
almost reminiscent of what one has in a commutative polynomial algebra, 
but there are also some easily believed hypotheses about n -factorisation that 

turn out to not be true. One of these is that Oi M^b = a2 should imply 





ai 

0(1^) O (c(g)C 

is 



a2, but for any c G Nw(fi)(l,0) it turns out that 0(P) (c ® c) 



that Eg 



1] 



N2 (c®c). Another example 
(l^). On the other hand, if 



= C(g)C = 0(^X^) o (c(g)c) -- 

1] ^\m = m = K 

one can nail down the join- vertices and vertex parity then isomorphism of 
symmetric joins implies isomorphism of respective factors by the second part 
of Lemma 18.71 
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Definition 8.15. Let a homeomorphism (/3,7) from a network L to a net- 
work G be given. For any e G Ei such that /^^(e) G Vl \ im /3, one says that 
7(e) G Eg is the edge subdivided by the vertex hiie). The subdivision 
index of the edge e G -El is the index k such that e = if {ei, . . . , e„} = 
13(7) ({7(e)}) are indexed such that tiiei) G im/3, hi^ei) = ^^(ej+i) for 
2 G [n — 1], and tL^Cn) G im/3. The subdivision index of the vertex 
hL^e) G is the subdivision index of e. All of these concepts are with 

respect to the homeomorphism (/3,7). 



That the subdivision index is well-defined is a consequence of Lemma 1731 
defining ({v) to be the edge subdivided by v and 9{v) to be the subdivision 
index, one even gets that {(, 9): Vl \ im /3 — )■ Eg x Z+ is an injective map. 
One point of the next lemma is that these data determine the subdivision 
up to isomorphism, but also that between subdivisions made using a subset 
of the vertices there are homeomorphisms in the expected manner. 

Lemma 8.16. Let Vt he an W' -graded set and y G ^2(1, 1). Let G G Nw(n) 
and X C N \ Vg be given, together with functions ( : X — y Eg and 9 : X — > 
Z+ such that (C, 9) : X — > Eg x Z+ is injective. Then for every A C X there 
exists a y-subdivision G{A) of G with Vg{a) = VgUA and a homeomorphism 
from G{A) to G of the form (id, 7^1) such that 

• // /iG(A)(e) = u or = u for some u & A and e G Eg{a) then 
lA{e) =Ciu). 

• If e e Eg{a) is such that /iG(A)(e), tG(A)(e) G A then 6'(/iG(A)(e)) > 
0{tGiA){e)). 

Moreover there exist '■ Eg(b) — > Eg(a) for all A C B C X such that 
(id, '^a,b) is a homeomorphism from G{B) to G{A) and = 1a° ^ a,b- 

Proof. One way to show this is to give an explicit construction of G{A). 
The vertex labels are prescribed in the statement, and a way of inventing 
edge labels would be to make them p-pairs of an edge label from G and the 
position along that edge as reflected in the value of 9 for the tail end (not 
quite the subdivision index, but close enough). This amounts to 

Vg(A) = U a, 

{Dg{v) iiveVG\{^A}, 

Dg{A)[v) = < -r . 

[y live A, 

Eg(A) = { p{e, 0) I e G Eg } U {p{C{u), 9iu)) | n G A } , 
lA{p{e,i)) = e. 
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and of course 



(tG{A),SG{A)){p{e,i)) 



{tG,SG){e) ifi = 0, 

((C, ^)~^(e, i), l) otherwise. 



The head map is a "next vertex on edge" map, so defining 

iV(e, i,A)= { e{v) I G A, Civ) = e, and e{v) > i } , 
M(e, i,A) = { e{v) \ v eA, C{v) = e, and e{v) ^ i } U {0} 

as helper functions, one can state it as 



'{hG,9G)ie) iiN{e,i,A)^0, 
{(,6)~^(^e,rmnN{e,i,A)), 1 j otherwise. 



ihG{A),gG{A)){p{e,i)) = 

The first three conditions for (id, 7^) to be a homeomorphism are trivially 
fulfilled. U p{e,i) G Eg(a) is such that /iG(A) i)) G Vg then this head is 
by definition /iG(e) = (id o /ig o 7yi)(p(e,i)) and similarly at the tail. Any 
V e A has p{C{v),9{v)) as only edge with v as tail and p{C{v),i) where 
i — maxM(C(f ), 9{v) — 1, A) as only edge with v as head, both of which are 
mapped to ({v) by •ja- Hence it has been shown that (id, 7^) is a homeo- 
morphism from G{A) to G. 

The definition of is 'ifA,B (p(e, i)) = p{e, max M(e, i,A)^, which triv- 
ially satisfies 7^ o ^a,b — 1b- To see that it is surjective, one may ob- 
serve that if p{e,i) G Eg(a) then p{e,i) G Eg(b) too since A <Z B, and 
clearly max M{e,i, A) = i, meaning '^A,B{piG,i)^ = p{e,i). These edges 
are precisely those which have tG(B){p{G,'i)) ^ Vg{a), and the restriction of 
(tGiB), sg{b)) to the set of these edges is exactly {tG(A), sg{a))- On the head 
end, let j — maxM(e, i, ^4). hG{B){p{e,i)) G Vg iff N{e,i,B) — 0, which 
implies A^(e,j,A) = 0, and thus {hG{B), 9G{B)){p{e,i)) = {hG,gG){e) = 
{hG{A), gG{A)) {p{^, j)) as required for (id, '^a,b) to be a homeomorphism. For 
edges p{e, i) with N{e, i,B) ^ there are two cases for v = hG{B) (p(e, i)) = 
{(,9)^^(^e,mmN{e,i,B)y If v E A then since 9{v) > i ^ j it follows that 
9{v) G N{e,j,A) and thus mmN{e,j, A) = 9{v) = mmN{e,i, B), meaning 
ihG{B),gG{B)){p(eJ)) = (v, 1) = (hG{A),gG{A)){pieJ)). If instead v e B\A 
then M[e,9{v),A) = M{e,i,A) and hence -^A,B{p{e,9{v))) = p{e,j) = 
\1'^^5 (p(e, i)) , as required at a vertex that is smoothed over by a homeo- 
morphism. The remaining conditions for (id, '^a,b) to be a homeomorphism 
are trivially fulfilled. □ 

The following theorem states that two xi -factorisations of a network can 
be combined, in the sense of combined factorisation that any factor of a 
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component factorisation appears as a join of factors in the combined factori- 
sation. For practical reasons, the result is stated in the particular case that 
one right factor has an embedding into the other right factor, but multiple 
applications of it would yield a combined factorisations also in the more gen- 
eral situation where two factors partially overlap; the trick is to observe that 
their "intersection" has embeddings into both. 

Theorem 8.17. Let G, Hi, H2, Ki, K2 G Nw(fi) he networks such that = 

[KiU X [^1]^ = [^2]^ X [H2h. Let G and (x2,V^2): 

G he the corresponding emheddings. If there exists an intermediate emhed- 
ding (xo^V'o)- Hi — > H2 such that Xi = X2 ° Xo ^''^d ipi = ip2 ° 4'o then 
there also exists some Kq G Nw(fi) such that [Ki\^ = [-ft'2]~ '^"(//2) [-^o]~ O'lT'd 
[H2U = [Koh X [^1]- 

Remark. It may appear as though this theorem should follow immediately 
from Theorem 17. 131 — since Hi has an embedding into H2 it follows that there 
is some Ko for which H2 is a subdivision of Kq xi Hi, and hence 

[Ki]^ X [Hi]^ = [G]^ = [K2U X [^2]^ = [K2h X ([^0]^ X [^1]^) = 

= [K2h ^fni {[Koh X [Hih] = {[K2h [Koh) x [Hi]^. (8.8) 

The catch is however that a mere embedding of Hi into H2 need not uniquely 
identify the padding [Kq\^ — one needs a strong embedding for that — and 
thus it could happen that K2 m'^^^-^Kq as constructed above is not a subdivi- 
sion of the given Ki, but a subdivision of some other network K[ which also 
happens to satisfy [K[]^ x [Hi]^ = [G]^. That [K2U n^JJJ [Kq]^ x [Hi]^ is 
a factorisation combining the exact decompositions from x and 

[K2]~ X [H2]~ is what the theorem is all about. 

Proof. Even if fl8.8p alone does not produce the wanted result, it captures 
the basic idea; what is missing is a detailed record of the subdivisions that 
are involved and the homeomorphisms between them. The first step for 
producing this will be to use Lemma [8. 161 to construct a subdivision G{A) of 
G which contains all join- vertices introduced by the symmetric joins in f l8.8p . 

Let ni = max Vb, let Ai = {ui j}je[a(//i)+c^(//i)], let n2 = ui + a{Hi) + 
u{Hi), let A2 = {n2 + j}je[aiH2)+uj{H2)], and let A = AiU A2. For i = 1,2, 
let (/3j,7i) be the homeomorphism from Ki x Hi to G. Define A — > Eg 
by making ({ui + j) be the edge that under (/3j,7j) is subdivided by 2 -|- j G 
VKiXiHi, and let 9i{ni + j) be the corresponding subdivision index of the join 
vertex 2 -|- j. Also let 02(e) be the subdivision index of e G Ek2x,H2 with 
respect to (/32,72)- Let m = a{Hi) + u{Hi) + 1, let f{v) for t> G Ai be the 
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edge e G E^^ such that 2e + 1 is incident with v — rii + 2 m Ki y\ Hi (i.e., 

hK^y,H^[2f{v) + l) =v-ni + 2{oiv> ni + a{Hi), and tx^>,//^ (2/(w) + l) = 
V — rii + 2 for f ^ rii + a{Hi)), and define ^ : A — > Z_|_ by 

~ |m^^2(V'o o + 1) - m + 9i{v) ii v e Ai. 

Since < 0i{v) < m for all v G Ai, it follows from the injectivity of {C,6i) 
and {(, 62) that (C, ^) is injective as well. Hence the conditions in Lemma rS.lGI 
are fulfilled and the three subdivisions (in the notation of that lemma) G{A), 
G{Ai), and ^(^2) of G exist. 

First consider G{A2)., which has a homeomorphism (id, 73) to G. Since 
for any e G Eq, 

|p(73)({e})| = 1 + n p(C)({e})| = |p(72)({e})| , 

it follows from Corollary 17.61 that G{A2) ^ x -f^2, with an isomorphism 
(X3,V'3): G{A2) — > K2 X H2 satisfying x{v) = hiv) for v G Vg- Since 9 
and ^2 assign the same relative order to subdivision vertices, it also follows 
that the relation between v & A2 and Xsl"^) is the same as between 62 and 
the (/32, 72) subdivision index: Xziv) = 2 + v — n2 for t> G A2. 

Next observe that (xs^'^s) composes with the canonical homeomorphism 
from G{A) to G{A2) to yield a homeomorphism (/34,74) from G{A) to K2 x 
H2; this satisfies ^^{v) = f32^{v) for v G im/32 and /34(2 + j) = ^2 + j for 
j G [«(i^2) + ^{H2)]. The vertices not in im/34 are those in Ai, so one 
may conversely wonder which edges these subdivide. Any rii + j G Ai for 
j ^ a(-ffi) corresponds to the edge e G -E//^ with tu^^e) = 1 and s//^(e) = j, 
so 6'(ni + j) = m92{2ipo{e) + l) — m + 6*1 (rii + j). This means it subdivides 
2^o(e) + 1, because C(2 + j) = 72(2V^o(e) + l), if m := hK.y.H^i'^Me) + l) ^ 
im/32 then 6'(/34(m)) = m6'2(/34(M)) = m6'^2?/'o(e) + l) > 6'(ni+j), and if := 
(2^o(e) + l) ^ im/32then^(/34(t;)) =m^2(/94(M)) ^ m^^2V'o(e) + 1) - 
m < 6{ni + i). Similarly provided tH^{e) = 1, any rii + a{Hi) + gHii^.) G Ai 
subdivides the edge 2ipo{e) + 1 G EK2XH2 under (/34,74). 

Being a homeomorphism to a symmetric join, (/34, 74) transports the sym- 
metric join structure back to G{A); a mere relabelling of the edges and ver- 
tices will make this explicit. Concretely there is a bipartition Eq U Ei of 
Eg{a) into the "even" edges coming from the left factor and the "odd" edges 
coming from the right factor: 

Eo= { e G EciA) I 2 | 74(e) } , ^1 = { e G Eg(A) | 2 t74(e) } . 
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Similarly there is a tripartition Vq U Vt, U Vi of Vg{a) into "even" , "neutral" , 
and "odd" vertices, where one preferably defines 

= {0, 1} U ^2 = p(/34)({0, 1} U {2 + j},eKH2)+c.(/f.)]), 

Vo = p{hGiA)){Eo) U p{tGiA)){Eo) \ V^, 

Vi = p{hGiA))m u p{tGiA))m \ v^. 

These Vq and Vi come out as disjoint, since if for example cq € Eq and ei G Ei 
are such that /iG(A)(eo) = ^G(A)(ei) then this vertex must be in im/34 since 
74(eo) 7^ 74(ei), and thus /ii^2x^^2 (74(eo)) = ^i^axHa (74(61)), which implies 
that 2 < /iiiTaxiTa (74(^0)) ^ 2 + a{H2) and thus /iG(A)(eo) ^ Vf,; the other 
combinations of head and tail work out similarly. 

Since 74 is injective on Eq (because the Ai vertices all subdivide edges in 
the odd H2 part of K2 x H2), it turns out that the left factor can be taken 
to be K2. A relabelling (^4, tp^j of G{A) which makes it so is given by 



live Vo, 
ifv G Vi; 

this is an isomorphism from G{A) to a network of the form K2 >i H2, where 
Eh^ = El and Vh^ = {0, 1} U V^i. By Lemma [8.71 the composite homeomor- 
phism (X40/34, 740 "^4^^) splits into separate homeomorphisms for each factor, 
and so there is a homeomorphism (/35,75) from H2 to H2. 

On the Ai side it similarly follows that G{Ai) ~ i^i x i^i and therefore 
there is a homeomorphism {Pq, jq) from G{A) to KiXiHi which has /36(2+j) = 
77-1 + j for all ni + j G Ai and (3e[l3i{v)) = v for all v G Vg- For no e G Eh^ 
is there any u E A2 that subdivides 2e + 1 G EkixHi under {(3^,'-^^), because 
|3(7e)({2e + 1}) is contained within 15(74) ({2^/'o(e) + !})• On the tail end, 
u E A2 with 9{u) ^ m^^2 (2'?/'o(e) + l) — m cannot subdivide 2e + 1, because 
the existence of that u forces 6^3 (2-00(6) + l) ^ 2 and thus %2('^o(e)) = 1, 
whence tH^{e) = 1 renders /36(^irixii?i(2e + 1)) = ni + SHi{e) G Ai, and 
6'(ni + SHi(e)) > m9' (2ipQ{e) + l) — m ^ 0{u); such m must be subdividing 
some other edge of Ki xi Hi. Similarly on the head end, some u E A2 with 
6{u) ^ m6'2 (2'?/'o(e) + l) cannot subdivide 2e + 1, because the existence of 
such a u requires there to be a segment of '?/'2 (V^o(e)) with subdivision index 
higher than that of V'o(e), whence /ij^j ('?/'o(e)) = and thus hu^^e) = 0, 
from which follows /96(^i4'ixi/i'i(2e + 1)) = ni + a{Hi) + gH^{e) G Ai, and 



2e+l ifeG^i, 
74(e) if e G ^0, 

a{H2)+uj{H2) + 2v + l 
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6'(ni + a{Hi) + guA^)) < mO' {2ipQ{e) + l) ^ 6{u). Therefore there is for 
every e G Eh^ a unique e' G Eg{a) such that 76(e') = 2e + 1, and moreover 
every e' G -EG(yi) with 76(e') = 1 (mod 2) has 74(e') = 1 (mod 2), /iG(yi)(e') = 
(/36 o /iKi>oHi o 76) (e') and tG(A)(e') = (/^e ° tx^^H^ o 76) (e'). 

As before, the symmetric join structure of Ki x Hi pulls back to G{A) 
over the homeomorphism (/Se^Te), and since all of Eq is in the even part, it 
can be seen as a symmetric join structure on Hi^- The bipartition of Ei is 

Eio = { e G El I 2 I 76(e) } and En = { e G | 2 f 76(e) } , 

and since furthermore 75 is injective on En, one can take the right factor in 
the symmetric join producing H2 to be i^i. A relabelling which does this is 
(X5,^/'5), where 

V -ni + 2 liv e Ai, 
(3i{v) iiveVH'^\Ai, 

2e if e G Eio, 
76(e) if e G E^. 

From this relabelling of H2 one gets Kq such that H2 — Kq x Hi, and thus 
[H2]~ = [Kq]^ X [-f^i]~, which is half the claim in the theorem. 

For the other half, one may observe that the isomorphism sequence G{A) ~ 
K^^H'^^K^^ (Ko X Hi) ~ {K2 M^jg] Ko) x H^ composes with (/36,76) to 
yield a homeomorphism {Py, 77) from (^K2 -^0) Hi to KiXi Hi. Work- 

ing through the steps one finds that /37(2+j) = 2+j for j G [a{Hi) +ijj{Hi)'j 
and /37(w) = 1 (mod 2) if and only if v = 1 (mod 2) for v G Vft:^>oHi- Hence 
{Pi ill) splits by Lemma [8.71 and yields in the left factor a homeomorphism 
(/38, 78) from N^gJ i^o to Ki. Thus [Ki]^ = [K^U N^g] [i^o].- □ 

9 Feedbacks 

Symmetric joins of networks will in the rewriting formalism be used for plac- 
ing rules in contexts. Since rules are expected to be compatible with an 
ordering of the networks, this implies that this ordering must be preserved 
by the operation of placing something in a context. Therefore there is a need 
to have a name for orderings that are preserved under symmetric join. 

Definition 9.1. Let Q be an N^-graded set. An N^-graded quasi-order P on 
the free PROP Nw(fi) is said to be preserved under symmetric join if 

a ^ a' in P and b ^b' in P implies a 6 ^ a' 6' in P (9.1) 



X5{v) = 

^5(e) = 
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for all r,q e N, A,B e B*^*, a, a' G yn{A), and b,b' e yn{B) such that 
A = [ill ill] ^li^^e ^22 G B'-x^ B = where G B'^x^ and 

A22B22 is nilpotent. The quasi-order P is said to be strictly preserved if a 
strict inequality for either factor in (19.11) implies a strict inequality between 
the respective symmetric joins. 

Lemma 9.2. An N'^-graded quasi-order P on the free PROP Nw(r2) which 
is preserved under symmetric join is a PROP quasi-order. If P is strictly 
preserved then it is a strict PROP quasi-order. 

Proof. In order to relate a P{1, m) comparison of h with h' to a P{k, n) com- 
parison of CO 60 (i with cob' od, where c G Nw(f2)(A;, /) and d G Nw(i7)(m, n), 
let a = c ® 0(1™-) o ^('"X') o d ® 0(1'); as this makes cohod = ay\h and 
c o 6' o (i = a X 6'. 

A similar argument for c®h®d where c G Nw(f2)(i, j), 6, h' G Nw(f2)(/c, /), 
and d G Nw(f2)(m, tt.) follows from taking a = 0(l*^'"X'^^ I') oc®(i®0('X'') o 
0(P T»r 'X*^ Tir l'^) and comparing a yi h = c®h ® d with ayih' = c®h®d. □ 

Previous work on PROP quasi-orders is therefore not lost, as all quasi- 
orders preserved under symmetric join are to be found among the PROP 
quasi-orders, but it reintroduces the question of how they might be con- 
structed. As stated before, the main approach to the construction of orders 
on Nw(f2) is to pull back an order on some other other PROP V over an 
evaluation homomorphism evalj, but this works well because the PROP op- 
erations are defined on both the domain and the codomain. The symmetric 
join is only defined on Nw(f2) and Nw(f2), so in seeking to establish preser- 
vation under symmetric join of an order pulled back, one faces the problem 
of showing things about evalj(a 6) given only information about eval/(a) 
and eval/(6) — it is not clear that one can even compute the former from just 
the two latter! As it turns out, the PROP operations alone need not suffice, 
but if the PROP structure of V is augmented with a feedback then there is a 
formula (which is the subject of Theorem 19. 8p in V for eval/(a 6). 

9.1 PROPS with unrestricted feedback 

Informally, a feedback is to take an output and connect it back to an input; 
in some cases this makes sense, and in other cases it doesn't. Consequently, 
some PROPs support an extra 'feedback' operation and others do not. We 
will primarily consider feedbacks that are partial operations — defined only 
on such elements in the PROP that they make sense — but it is useful to first 
define what they behave like when defined on all elements. 
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Tightening 




Superposing 




Sliding 



Figure 5: Schematic representation of some feedback axioms 



Definition 9.3. A PROP with feedback is a PROP V together with a 
family {t"}neN of partial unary operations such that af" G V{k, I) for all 
a G V{k + n,l + n). These must satisfy the following axioms: 

tightening (a (g) 0(1") o b o c (g) 0(1")) t"" = a o o c for all a G V{i,j), 
b G V{j + n, A; + n), and c G V{k, I). 



superposing a (g) = (a (g) 6)t" for all a G 'P(i, j), b G V{k + n, I 



n] 



sliding (0(1* 



a o 



6)1™ = (6 o 0(1') ® a)t" for all a G P(m,n), 6 G 



P(A; + 72, / + m). 

vanishing at"!'" = af^"^" if a{a),uj{a) ^ m + n and at° = a for all a eV. 

yanking 0("X")t" = 0(1"). 

If in addition they satisfy the axiom of 

normalisation 0(l")t" = 0(1°), 

then the feedback is normalised. 

See §tefanescu [Ul pp. 22-24] for references and notes on this particular 
axiom system. He includes normalisation in the basic axiom system. 

In the context of abstract index notation, taking a feedback is generally 
known as contracting: using the same index as sub- and superscript of a 
single factor. When that factor is a matrix, one ends up with an expression 
of the form A], which for A G 'Hom7^n(l, 1) and in more classical notation 
becomes Yl'i=i — tr(A); hence another term used for feedback operations 
is trace map. Note however that the normalisation axiom would require 
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of the identity matrix / = | l] to be 1 rather than the dimension n, so 
a normahsed is more hke - tr than tr. Such normahsation can actually 
be useful, because operators on infinite-dimensional spaces need not have a 
finite trace (those that do are said to be of trace-class, which is comparatively 
small) , whereas ^ tr — an "average diagonal element map" — generalises to a 
larger class of operators. On the other hand, the normalisation by ^ in ^ tr 
will break the yanking axiom for Tiom-jin , so one cannot achieve normalisation 
simply by slapping on an extra factor. Furthermore it can be useful to 
go unnormalised; when Penrose wrote about "applications of negative 
dimensional tensors", he was referring specifically to theories where [• | l]t^ 
is negative. 

Theorem 9.4. Let V be a PROP with elements U E V{0,2) (the cup) and 
A E 7^(2,0) (the capj such that 

0(1^) ® U o 0(1X1) ® </.(|i) o 0(|i) ® A = 0(|i). (9.2) 

Then V is a PROP with feedback, where 

af := a, (9.3) 

af := 0(r('^)-i) ^Uoa^ 0(1^) o 0(r(")-i) ® A, (9.4) 
at" := (at')t""\ (9.5) 

for all a E V and 1 <n ^ max|a(a), a;(a)}. Defining 

Ao := 0(1°), A„+i := 0(1") ® A ® 0(1") o A„, 

Uo := 0(1°), Un+i := Un o 0(1") (g)U0 0(1") 

for all n eN, it also holds that 

at" = 0(r(«)-") ® f/„ o a ® 0(1") o 0(r('^)-") ® A„ (9.6) 

for all n E'N and a eV with a{a),u){a) ^ n. 

Remark. Instances of 09. 2p are not all that common in the literature; more 
common are instances of the "zig-zag identities" 

t/®0(i^)o0(|i)®n = 0(|i), 

0(1^) ®MO A®0(|i) = 0(|i), 

which however are easily converted to fl9.2p by defining A = 0(^X1) o n or 
U = u o 0(^X1) respectively. Furthermore, it is not uncommon that cups 
and caps are symmetric (A = 11 and U = u). One case where the cap 
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and cup satisfying the zig-zag identities are not symmetric is that of ribbon 
categoriesj^ and in that case the value of 0(1"^) ® m o 0(^X^) ° 0(1^) ® H 
would be a twist of a ribbon rather than 0(1^). 

Proof. Beginning with f l9.6p . it is clear that 

® f/o o a (g) 0(1°) o 0(r(«)) (g) Ao = 0(r('^)) oao 0(r('^)) = a = af , 

providing the basis for an induction on n. Assuming that fl9.6l) holds for 
n = m, it follows from 

o ® f/ o a 0(1^) o 0(r(")-i) ® A) ® 0(r) 

o ® A„ = 

oa®0(|i) ®0(r) 

o 0(r(")-i-™) ® 0(r) ® A ® 0(r) o 0(r('^)-i-"^) ® a„ = 

that it also holds for n = m + 1; hence it holds for general n. 
Concerning the axioms, one may observe that 

A„ = [s-i-Sr,t„-h I ni=l(^)*'*'] ) 

Hence defining r = ri ■ ■ ■ r„, s = si ■ ■ ■ s„, and t = t„ ■ ■ ■ ti (note order of tj), 
the yanking axiom is verified through 

= m ® I nr=i(f^)..*j ° e 1 1] ® 0(1") ° 0(1") ® [st 1 nr=i(A)^'*'] = 
= [r I uiiiuu.] o [-^ 1 1] o [i^, I nr=i(A)^^*-] = 

^ Which are natively braided monoidal categories rather than symmetric ditto, so the 
issue of what 0(^X^) even means in that case is not entirely trivial. However if one does 
not require the ribbons to be concrete topological objects then it is mathematically no 
problem to consider ribbons that can pass through each other, and then the braiding 
reduces to full symmetry. 
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n n 



= (8)C: I (A^* "(^u] = (8)0(1') = 



Vanishing is satisfied by definition. For shding of a G V{m,n) past b G 
V{k + n,l + m), one may define r = ri ■ ■ ■ r;, s = Si ■ ■ ■ Sm, t = ti - ■ ■ tm, 
u = Ml ■ ■ ■ Un, V = wi ■ ■ ■ w^, w = wi ■ ■ ■ Wk, X = xi ■ ■ ■ Xn, and z = Zi - ■ ■ Zm- 



{<p{\'')®aoh)r = 

= 0(1'=) ^Umo 0(1'=) ® a ® 0(r) o 6 ® 0(r) o 0(1') ® A„ = 

= [r I (t^™)zt] O [ZTt I a^u] ° 0(1' ^ I" * I"') ° [wxt I Csl ° [rst I i^mY'] = 

= [r I iUmUal] o [:^^ I (A„)"-(f/„)xv] o [^,, I 6rs^(A^)^*] = 

= [I, I (f/„.)zt<(An)""(f/„)xv&rs"(Ar«)^*] = 

= [T I (t^n)xvCsl ° I iUmUiA^mr] O [^v | <(An)"1 = 

= I (f/n)xv] O I O 0(1^= ^ I- ^ 1") O [-V I ^zj ^ ^r^^ | (^^)uv] ^ 

= 0(1'=) ®UnOb® 0(1") O 0(1') ® a ® 0(1") O 0(1') ® A„ = 

= (6o0(|')®a)r. 



a ® 6t" = (0(1') o « o 0(1')) ® (0(1'') (S)UnOb(g) 0(1") O 0(1') ® A„) = 

= 0(P * 1'=) t/„ o a ® 6 ® 0(1") o 0(P * I') ® A„ = (a 6)t". 

Similarly tightening is that 

(a®0(l")o6oc®0(r))t" = 
= 0(r) ® f/„ o a ® 0(1") ® 0(1") o b ® 0(1") o c ® 0(1") ® 0(1") o 0(1') ® A„ = 
= ao 0(P) ® [/„ o 6 ® 0(1") o 0(1^=) A„ o c = a o 6t" o c. 



Example 9.5. The connectivity PROP of Example 13.31 has a cap and cup 
pair, namely 



Then 



Superposing is merely that 



□ 



A= ({{l,2}x 
[/= ({{l,2}x 



{o}},o), 
{i}},o). 
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With respect to fl9.2p . one finds that 

0(|i)®A = ({{(1,0),(1,1)},{(2,0),(3,0)}},0), 
00X^^1^)= ({{(1,0),(2,1)},{(2,0),(1,1)},{(3,0),(3,1)}},0), 
® t/ = 0), (1, 1)}, {(2, 1), (3, 1)}}, O), 

meaning 

® U o 0(1X1 ^ |i) = ({{(1, 0), (2, 1)}, {(1, 1), (3, 1)}}, O), 

so that 0(|i) ® f/ o 0(1X1 * |i) o 0(|i) ® A = 0(|i). 
This PROP is not normahsed, since 

f/o A = (0,1) ^ (0,0) = 0(1°). (9.7) 

As mentioned previously, caps and cups may also turn up in 'Homy style 
PROPs, but here it should be observed that it makes a significant difference 
whether V is finite- or infinite-dimensional. When V is finite-dimensional, 
{^i}i=i is some basis of 'Homv(l,0) = V, and is the corresponding 

dual basis of T-LomviO,!), then one can simply let A = ^"^^ Cj ® Cj and 
U = E"=i/j ® fj^ since 

n n n 

'^c^) = ° = X] X] ° (•^j ° ° = 

1=1 i=l j=l 

n n 

= ^ 5^ 0(1') ® /, ® /, O 0(1X1) ® 0(|1) O 0(|1) ® ® = 

i=l j=l 

= 0(|i) ® U o 0(1X1) ® 0(|i) o 0(|i) ® A. 

A taste of the infinite-dimensional case can be had by considering as V some 
suitable class of functions M — > C. Zig-zags can be found for such things — 
one starting point could be the Fourier and inverse Fourier transformation 
combination 

1 /»00 /"OO 

f{x) = ^ e'P^ / e-'Pyf{y) dy dp for all s G M and f eV. (9.8) 

^-oo J -oo 

The inner integral here is an inner product f{y)g{.y) dy for g{ii) = e*™, 
so this would constitute an obvious cup candidate — were it not for the fact 
that this is sesquilinear rather than bilinear, as an element of 'Homv{0,2) 
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would have to be. Instead taking that integral without conjugation as cup, 
and the rest of fl9.8l) as the corresponding cap, one gets 



Because these were obtained from fl9.8p . they satisfy the basic instance fl9.2p 
of the yanking axiom, but regarding normalisation one finds that 



which is rather divergent; clearly the composition of two PROP elements 
should rather be something finite. 

Of course, one could argue that the divergence problem is present already 
in the definition of A. Certainly this A is not an element of ?^omv(2,0) = 



V ®V, since A = ^ fp O Qp dp for fp{x) = e'P'' and gp{y) = e *™ is 



at best an integral over elements f ® g for f,gGV, rather than the finite 
sum of such elements that an element oi V C^!) V must be; that the tensor 
product only does finite sums is also why the dual of an algebra need not 
be a coalgebra. There could be some other PROP which is similar to l-Lomv 
but not so restricted (for example, it might be defined using a tensor product 
analogue that also takes a topological closure) in which A finds a home. While 
it may seem to a mathematician that the integral should still be hopelessly 
divergent since the integrand does not tend to as p — )■ ±00, a physicist 
would probably have recognised ^w{^-y) dp a standard formula for 

the Dirac 6{x — y), which is a very natural cap candidate when dealing with 
spaces of functions. Having tamed A with the formal framework of Dirac 
delta functions and found a name for what it is does however not get rid of 
the infinity: U o A = 6{x — x) dx = 5(0) dx is every bit as divergent 
as the previous expression for this composition. 

9.2 PROPS with formal feedback 

The problem above is not so much constructing a feedback from separate cap 
and cup elements, but rather that the feedback itself becomes a troublesome 
concept when it must apply to arbitrary elements. (Several technicalities in 
Section H] are all about making sense of the abstract index notation without 
resorting to feedbacks; if the target is from the start known to be a PROP 
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with feedbacks then it would be straightforward to define an "abstract in- 
dex notation with contraction" that drops the acychcity constraint.) An 
interesting problem when given a PROP is therefore to distinguish sets of 
well-behaved elements on which feedback maps can be defined. 

In the free PROP Nw(f2), a natural approach to defining such a restricted 
feedback is to make use of the symmetric join and define 

ar = a^l(P{y'). (9.9) 

The necessary and sufficient condition for this to be defined is that Trf(a) = 
[921 922] has q22 £ B"^" nilpotent, so it appears the domain of that is 

[J yn {[VA 922]) • 

[921 922 J 
922 eB"^" is nilpotcnt 

From fl9.9p and Construction 17.1^ one may also conclude that Trf(at") = 
qii + 5'i2'?225'2i; which is equivalent to at" G yn{qii + '?i25'22'?2i)- Replacing 
by a general B*^ '-filtration, we arrive at a definition that makes sense for 
a general PROP. 

Definition 9.6. Let a PROP V and B'^" '-filtration {Fj^gB-x* in V be given. 
A formal feedback in V with respect to {-Fg}qgB«x« is a family {t"}ra6N of 
partial maps from V into itself satisfying: 

1. at" is defined whenever a e Fg such that q = [Hi til] has ^22 e B"^" 
nilpotent, and moreover at" G Fr where r = qu + gi25'22Q'2i- 

2. The tightening, superposing, sliding, vanishing, and yanking axioms 
of Definition 19.31 are satisfied whenever the expressions involved are 
defined. 

A PROP with formal feedback is a triplet [V, {FgjggB.x., {t"}neN) , where 
P is a PROP, {-FgjggB'x* is a filtration of V, and {t"}raeN is a formal feedback 
with respect to these. 

There would not be much point in defining normalised formal feedbacks, 
because the normalisation axiom will typically not be applicable for formal 
feedbacks. If 0(1") G Fg and q is nilpotent (as it would need to be for a 
formal t" to be defined), then 0(1") = 0(1")°" G Fgn = Fq. Furthermore 
for i = 1 G B^^i, z = e B"^", and Z = G b("+i)x("+i), one finds 
0(r+i) = 0(|i) ® 0(|«) o 0(1") ® 0(|i) G Fi^.o.^i = Fz and hence 0(1^) = 
0(|i) ® 0(l")t" = 0(l"+^)t" G Fq. From this follows that the Fq sets are the 
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whole PROP, so the feedbacks must in fact be unrestricted; a PROP with 
formal feedbacks where the normalisation axiom would apply somewhere is 
in fact a PROP with feedbacks, period. 

An important example of PROP with formal feedbacks is the TZ'^* matrix 
PROP. 

Lemma 9.7. Let TZ he an associative unital semiring. Then TZ'^* , with the 
dependency filtration {-Fgjgei'x*; is a PROP with formal feedbacks given by 



'An 


A12 




A21 


A22_ 





An + AuA*A2i 



(9.10) 



for all Au E 11"''% A12 e TZ^'"'^ , A21 E 7^"^^ and A22 E Fg where q E 1"''" 
is nilpotent. 

Proof. That A22 is defined follows from Lemma [6.11[ so what remains is to 
check that the feedback defined satisfies all the axioms. 

With notation as in Definition 19. 31 one finds for the tightening axiom that 

(a®0(l")o6oc®0(r))r = 





a 







'bn 


bl2 




C 







-71 


abiic 


abi2 




( 





0(1"). 




p21 


&22_ 







0(1"). 


) 




_ &21C 


b22 _ 





= abnc + a6i2&22^2ic = a{bn + fei2&22^2i)c = a o b'\^ o c 

for all a E 7^*^^ b = [l^ l^] E 7^(^■+")^(^+") such that 622 e Fg where 
q E B"^" is nilpotent, and c E TV'^K 

The superposing axiom is similarly just a matter of 

-.n 



a (g) bY' 



a 


" 




a 





6t" 




bn + &12&22^21 



a 





" 







bn 


bi2 







b2i 


&22_ 





(a ® b)Y' 



for all a E TZ'"'^ and b = [l^ l^] E n^k+n)x{i+n) g^^^ ^^la^i 622 e Fg where 
g G B"^" is nilpotent. 

For sliding, consider a E Fr and b = [^^^ ^^2] ^ ^1 where r E B"^^", 
q = [qll 922], qu e B'^^', gi2 E B'^^™, ^21 e B"^'' and g22 e B"^™ are such 
that rg22 (and equivalently 522^") is nilpotent. Then (a622)*o = a(622«')* by 
Lemma 16. IH and hence 



(0(l'=)®ao6)f 



bn + bi2{ab22)*ab2i = bn + &i2a(&22a)*&2i 





Xi'^) 0" 




'bn 


bl2 


) 




bu bi2 




( 


a 




_&21 


&22_ 






0621 0-622 





'bn 


bi2a 






'bn 


bi2 




0(10 


0" 




b2i 


622 a 






b2i 


&22_ 







a 


)1 



(6o0(|')®a)t". 
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Vanishing is a bit trickier. Here one must consider 



Oil ai2 ai3 

O2I 0,22 0,23 
O3I ^32 ^33 



where 



has qn G 



sfcxZ 



g22 e 



and gss G 



gii qi2 qi3 

q2i q22 q23 
Q3I ?32 933 

Moreover, the immediate 



condition for a'|'™''''"to be defined is that [^32 533] is nilpotent, whereas the 
immediate condition for at"t™ to be defined is that ^33 and 522 + '?235'33'?32 
are nilpotent; these conditions are however equivalent by Lemma 16.101 In- 
troducing the shorthand 0232 = ct23«33032, and using Lemma [6. IH one finds 



ciii + 013^^33031 ai2 + 013^33032 
021 + 0.23033031 O22 + 0232 



Oil O12 Oi3 

O21 O22 O23 
031 O32 O33 

= On + 013033031 + (ai2 + 013033032) (O22 + 0232)*(021 + O23O33O31) 
= On + 013033031 + (O12 + 0i3a33 032)(0220232)*022(021 + O23O33O31) 
= On + (012 + 013033032) (022 0232)*022 021 + 

+ 013033031 + (012 + 0i3033032)(022 023033032)*022 023 033 03i = 

= On + (O12 + 0i3033032)(022 0232)*022 021 + O13O33O31 + 

+ 0i2022a23(033 032 022 023)*03303i + 013(033032032023 

= On + (O12 + 0i3 033032)(022 0232)*022 02l + 

+ (O12O22O23 + 0i3)(033032 022 023)*03303i = 

(022 0232)*022 O22O23 (O33O32O22O23) *033 

033032(0220232) *022 (033 032 022023)*033 



)"'"03303i 



On + [012 013] 

= On + [012 013] 





021 




031 _ 



022 


023 


* 


021 


032 


033. 




_031_ 



On 012 Oi3 
O21 O22 O23 
O31 O32 O33 



n+m 



Finally, the verification of the yanking axiom is simply that 



0("X")f 



'0 


In 




In 








+ /„o*/„ 



where /„ denotes the n x n identity matrix. 



□ 



The same operations also constitute formal feedbacks in the biaffine 
PROP Baff(7?.), but it turns out the end of establishing that a particular 
quasi-order is preserved under symmetric join does not require that each 
and every PROP employed in defining this orders is equipped with a formal 



140 



feedback; there is often an easier way of getting there. That way does how- 
ever still rely upon having a general formula for eva\f{K H) in terms of 
eval/(ii'), eval/(if), and the operations of a PROP with formal feedbacks. 

Theorem 9.8. Let (P, {-FqlggB-x*, {t"}neN) be a PROP with formal feed- 
backs. Let Q be an N'^-graded set and y G 1) some element. Let 



/: fl — > V be an N"^ -graded set morphism such that f{y) 
H,K & Nw(n) are such that 



Trf(ir) 



flu ai2 

0-21 0-22 



where an G 



okxl 



, 0-22 e 



srxq 



, 622 e W"-, and 633 e 



^22 ^23 
&32 ^33 



are such that 



022^22 nilpotent, then 



lVX'^)oeval/(ir)®0(r)o0(|')®eval/(i7)o0(|'^"X"))f . 

(9.11) 



Schematically, what this theorem says is that 



eval 





which should seem plausible on account of the two diagrams being topolog- 
ically equivalent. The right hand side is however an expression in a specific 
PROP with feedback, whereas the left hand side is (the evaluation of) a net- 
work, so the topological equivalence must be taken more as a roadmap to 
understand what individual steps below are about than as an actual proof. 

Moreover, the proof is somewhat long and will be interrupted by various 
lemmas that establish facts useful not only in the specific context of proving 
Theorem 19.81 As in Section |8l the various data defining a network are referred 
to using their basic symbol {V, E, h, g, t, s, and D respectively) subscripted 
by the network at hand. 

y 

Lemma 9.9. For any K,H G Nw(f2), the network G = K H has a split 
(Fi, Fr, W\, Wr) such that the induced decomposition {G\, G^) has G\ K and 

Gr^H. 
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Proof. The split is given by 

Fi = { e G Eg \ e even } , Fj- = {e E Eg \ e odd } , 

Wi= {v eVgX {0,1} \ v even } , = {v E Vg\ {0,1} \v odd} 

and the two isomorphisms mostly consist of doubling the labels (for K), or 
doubling the labels and adding 1 (for H). □ 

This lemma provides for the base case of an induction over r + q, since if 
r = q = it follows that 

evalfiK i/) = eval/(ii') ® eYa\f{H) = 

= evalfiK) ® 0(1™) o 0(1') (g) evalfiH) = 
= 0(1'=) ® 0(r) o evalfiK) ® 0(1'") o 0(1') eval/(if) o 0(|') ( 
= 0(1^) ® 0(°X"^) o eval/(ir) ® 0(r) o 0(1') ® eval/(iJ) o 0(|') ( 
= (0(1^) ® 0("X'") o eval/(K) ® 0(r) o 0(1') ® sYaAfiH) o 0(|') ® 0("X'-))r . 

Unsurprisingly, the induction hypothesis is that (19. lip holds whenever r + q 
is one less than for the two networks K and H currently being considered. 

What is perhaps more surprising is that the only case in which this 
hypothesis will be invoked directly is when K has an edge Cq such that 
hRi^o) = 0, gKi^o) = k, txieo) = 1, and sxieo) = l + q. Schematically, what 
one wants to prove then looks like 



in- 

("X° 



evalf 





(9.12) 



and this is done by reducing to 



eval 





(9.13) 
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where the latter equahty holds by the induction hypothesis. 

A proper proof will show that the left hand sides of fl9.12p and fl9.13p are 
equal, and ditto the right hand sides, but first it must be sorted out what K' 
is for the given K. In -k ^X^) ■ K, the head index of cq is the maximal 
k + r, just as the tail index is the maximal / + q. Hence (l'^"^ -k ^X^) ■ K has a 
split with Co in the right part and everything else in the left part; let K' be 
this left part. Then 

eval/(ir) = 0(l^-^*"Xi) oeval/((l^-^^^X") -ir) = 

= 0(1'=-') ® ^y}) o eval/(fr') ® 0(1'), 

hence 

0(1^ ^ '^X'") o eval/(ii') ® (piT) o 0(1') ® evalf{H) o 0(|' * "X") = 

= 0(1^ ^ '^X™) o (0(1'=-') ® 0f X^) o eval/(ir') ® 0(1')) ® 0(r) 

o 0(1') evalf{H) o 0(1' * "X") = 
= 0(1^= * "X'") o 0(|'=-i) ® 0('-X') ® 0(r) o eval/(ir') ® 0(1'+"*) 

o 0(1') ® evalf{H) o 0(1' * "X") = 
= 0(1^=-') ® 0rXi+'") o eval/(ir') ® 0(1^+™) 

o0(|') ®eval/(/7) o0(|'^"X") 

and thus (0(1^= ^ ^'X"*) o eval/(fs:) ® 0(r) o 0(1') ® eval/(if) o 0(1' ^ '^X''))f = 

y 

eva\f{K' H) by the induction hypothesis. 

y y 
The reason G = K H and G' = K' P4^^_^ H evaluate to the same 

thing is that the former is a subdivision of the latter; the extra vertex in 

G is that labelled 2 + r + g, which also is the tail of Cq's counterpart 2eo. 

Cutting G above that vertex, one obtains a decomposition {Go,Gi) where 

Go = Nw(|^^ I (2 + r + g: y)|^) for ||a|| = A; - 1, ||c|| = m, b = 2eo and 

d = 2ei + 1 for that ei G Eh which has /i//(ei) = and gniei) = Q- 

Furthermore Gi ~ G' — the only difference in the labelling being a shift of 

vertex labels above 2 + r + g by 1 since G' has one join vertex less — and thus 

eval/(G) = eval/(Go) o eval/(G'i) = 0(1'="') ® f{y) ® 0(1™) o eval/(G") = 
= 0(1*^-') ® 0(1') ® 0(1") o evalj(G") = 0(1^+™) o evalj(G") = eval/(G") 

as claimed. 

The next case, which can be reduced to the previous one, is the mild 
generalisation that the edge Cq has / < sxieo) < I + q rather than sx(eo) = 
I + q. The way to perform that reduction is effectively to permute the join 
vertices. 
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Lemma 9.10. For any K e Nw(fi)(A; + r, Z + gr), H e Nw(fi)(gf + m, r + n), 
(7 e Eg, and r e E^, /ioZc?s that 

{K ■ (I' ★ a)) (ii" • (r ★ r)) ~ ((l'^ ★ r) • i^) (((J ★ T) • ii") (9.14) 
whenever either side of the equation is defined. 

Proof. Let K' = K ■ {\^ a), H' = H ■ {t i< I"), K" = (1*^ ^ r) ■ iT, and 

y y 

H" — (cr^ 1"^) • H. Then the isomorphism (x, V') from K' ^A^'^H' to iiT" i7" 
has being the identity, and 

{V iff^lor^;>2 + r + g', 

2 + t(v-2) if2<'t;^2 + r, 

2 + r + (7('t;-2-r) if2 + r<^;^2 + r + g, 

because if ei e E'ij is an output leg with gH^^i) ^ 9 then the corresponding 

y 

edge 2ei + 1 from the symmetric joins has head 2 + r + ^(^(ei) in K' ^ ^ H' 

y 

and head 2 + r + a (^x(ei)) in K" ^qH". In the latter case, the edge leaving 

that vertex is 2e2 for 62 G -Ei^ such that sk{g2) — I = cr(^gK{ei)), but that 

is equivalent to (7~^ (5^^(62) — /) = gxi^i), which is the condition that the 
y 

head in X' if' of 2e2 is 2 + r + ^(^(ei). Hence the joining of output legs of 
iJ'to input legs of K' is the same as that of output legs of H" to input legs 
of K", which is what the isomorphism requires. The effect of r is checked in 
the same way. □ 

Thus, if (7 e Eg is such that I + a{q) — {\^ -ka){l -\- q) — Sxieo) then 

eval/(i^' ^^H)^ 

= eval/((X- (I'^cr) • (I'* (7-^)) >i[H^ = 

= evalj (ir • (I' ^ a)) N ; ((a"^ ^ T ) ■ iJ) ) = 

= (^0(l'=^''X'")oeval/(X- (l'^(7)) (8)0(n 

o 0(1') ® eval/(((T-' * r) • H) o 0(l' * "X"))f = 
= (^0(1'= ★ '■X'") o (eval/(i^) o 0(1' ★ a)) 0(r) 

o 0(1') (g) (0((7-^ ★ r) o eval/(//)) o 0(1' ★ "X^))t'' = 
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= (^(/.(l'^ ^ ''X'") o evalfiK) ® 0(1™) o 0(|' ^ a * T) o 0(|' ★ cr"^ * T) 

o0(l')0eval/(ii")o0(l'^"X''))f = 
= (^0(1'= ★^X"^) o eval/(X) (8) 0(r) o 0(1') eval/(//) o 0(1' ★ "XO)r- 

Finding such edges through K is however not a very common occurrence, 

so the third case deals with manufacturing them, by making a suitable cut 

y 

in the network. Let G = K \a'^^H. By acyclicity, there is a partial order P 
on Vg which has hc^e) < tcie) in P for all e e £^g; pick the minimal such 
order. The third case covers those G for which the restriction of P to the 
join- vertices has a minimal element vq satisfying 2 + r<t'o ^ 2 + r + q (and 
which have not been covered by the first or second case already). 

Let Wo = {v eVG\ {0, l}\v <Vom P} and Wi = Vq \ {0, 1} \ Wq] 
then (Wo, Wi) is a cut in G. Let Ec be the set of cut edges. The odd 
(i.e., corresponding to H-) edges in Ec are the odd edges with head 0, since 
all join- vertices are in Wi, and by minimality of P all inner vertices of H 
therefore must be mapped into Wi as well. There are m such edges, so 
define k' = |ii^c| — For an ordered cut {Wo, Wi,p) it is convenient to define 
p(e) = fi'G(e) — k + k' for these odd edges. Furthermore let Cq G Ek be the 
edge such that tai^eo) — vo- This is a cut edge too, so define p(2eo) = m'. 
Remaining cut edges can be put in any order. 

The main idea for this third case is that in the decomposition [Go, Gi) 

induced by the ordered cut {Wo,Wi,p), the upper part Gi is itself a sym- 

y 

metric join Kii^ '^H for the Ki obtained by making the corresponding cut in 
K, whereas the lower parts Go and Kq differ only by some padding. Clearly, 
{W^, Wi) is a cut in K for 

W;,= {veVK\{0,l}\r + q + 2veWo}, 
W[= { ^; e \ {0, 1} I r + g + 2^; e W^i } ; 

let E'^ be the corresponding set of cut edges, k' of those are the e e Ek for 
which 2e e E^, but there are also r edges with head and head index > k; 
these are the edges whose counterparts in G have their heads at join vertices. 
Therefore define 

u , fp(2e) ff 2e e E,, 

Py^i^^i for e e E^. 

\k -\- SKye) — k otherwise 

Then let {Ko,Ki) be the decomposition of K corresponding to the ordered 
cut {W(„W[,p'). 
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What happens is that Gi = -ft'i H — not merely isomorphic (even 
though that would suffice), but actually equal — since relabels vertices 

and edges in the exact same way regardless of what networks they are part 

y 

of, and all vertices and edges in Ki are present also in K; clearly Ki n~^^H 
contains all the if-, join-, and non-inner vertices of G and hence Gi, and the 
condition for a i^-vertex to end up above the cut in G is exactly the same as 
for it to end up in Ki. Similarly e G Ek satisfies e G Ek^ iff tA'(e) G iy{U{l}, 
which is equivalent to the condition tG(2e) G Wi U {1} for its counterpart 2e 
to end up in Gi. The only area where something could happen is at the cut, 

but this choice of p' is the one which ensures that any edge 2e for e G -E^ 

y 

has the same head and head index in f^i as it does in G\. Letting 

a = 0(1^) (8> eval/(-ff) o 0(1' ^ "X*") as a shorthand, one therefore has 

y 

eval/(G') = eval/(G'o) o eval/(Gi) = eval/(G'o) o evalj(fCi txi H) = 

= eval/(Go) o (0(1'=' * '^X'") o evalf{Ki) ® 0(r) o a)f 

y 

on account of Ki having the edge Cq which makes i^i N if fit the first or 
second case. 

Regarding the lower parts Go and Kq, one may observe that these have 
splits in which the right parts consist of m and r respectively parallel edges. 
Writing (Gqo, Gqi) and {Kqq, Kqi) for the corresponding decompositions, one 
may furthermore observe that Gqq ~ Kqq with the isomorphism (x, ip) from 
i^oo to Goo having ip{e) = 2e and x(f ) = r + g + 2^; for t> > 1. Therefore 
eval/(Go) = eval/(Goo) ® eval/(Goi) = eval/(iCoo) ® 0(1™"), and hence 

eval/(Go) o (0(1'=' * ''X™) o eval/(iri) ® 0(1") o a)f = 

= eval/(iroo) ® 0(1"') o (0(1''' * 'X™) o eval/(iri) ® 0(1™) o a)f = 
= (eval/(iCoo) ® 0(1") ® 0(1") o 0(l'' * 'X'") o eval/(i^i) ® 0(1™) o ajf = 
= (0(1^= * ^X™) o evalj(iroo) ® 0(1") ® 0(1™) o eval/(i^i) 0(1™) o ajf = 
= (^0(1'= * ^'X™) o (eval/(iroo) ® 0(1") o eval^(iri)) ® 0(1™) o ajf = 
= (^0(1'= *"X™) o (evalj(i^o) o eval/(iri)) ® 0(1™) o a)f = 

= (0(1^ * "X™) o eval/(i^) ® 0(1™) o a)f 

as claimed in flQ.lip : this sequence of equalities features the only use of tight- 
ening in this proof to move some right hand side material (other than mere 
permutations) out of the feedback. 
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The fourth and final case of the induction step concerns those K H 
where none of the join-vertices from H to K is minimal in the partial order 
P. Since the set of join-vertices is finite, it must contain at least one minimal 
element, and since it is not one of those from right to left factor it must be 
one from right to left factor and may be denoted by 2 + i for some i G [r] . 
This implies that in 

G' := ("X™ ■ H ■ "X'^) N« C^X" ■ K ■ '?X') ~ '^X'" ■ G • "X' 

(isomorphism by Lemma 17.31) the join-vertex 2 + q + i is minimal under 
this partial order, and hence G' falls into one of the first three cases. Thus 
an evaluation of this symmetric join can schematically be reduced to an 
expression involving feedbacks as shown in Figure O the formal counterpart 
of which reads 

eval/(G) = 0(™X^) o eval/(G") o 0('X") = 

= 0(™X'=) o (^0(r ^ ^X'^) o eval/(«X'" ■ H ■ "X"^) ® 0(l'=) o 

o 0(r) ® eval/C^X" ■ K ■ "X^) o 0(1" * 'X^))t' ° ^CX") = 
= (^0(™X'=) ® 0(1'?) o 0(r * «X^) o eval/(«X"^ ■ H ■ "X"^) O 0(1'=) o 

o 0(1") (0('=X") o eval/(ir) o 0(«X')) o 0(1" * 'X^))t' o 0('X") = 
= (^0(™+«X'=) o eval/C'X™ ■ H ■ "X'^) ® 0(l'=) o 

o 0(1") ® (0('=X'') o eval/(ir) o 0(«X') o 0('X5)) o 0('X") = 
= (0(1^') ® eval/C^X" ■ ■ "X"^) o 0("+'-X^') o 

o 0(1" *^X) 0(1") ®eval/(ir))t'o0('X") = 
= (^0(1^') ® (0('?X™) o evalj(if) o 0("X'')) o 0(1'= * ^X") o 

o 0("X'=+'') o 0(1") ® eval/(ir) o 0('X") ® 0(1^)) = 
= (0(1*^ * '^X"^) o 0(1'=) ® eval/(i/) o 

o evalf{K) ® 0(1") o 0('+'?X") o 0('X" * l'?))t' = 
= (0(1*^ * "X"^) o 0(1'=) ® eval/(/f) o eval/(ir) ® 0(1") o 0(|' ^ "X'?))t'' 

but this expression differs from the right hand side of (19.1 ip in that evalf{H) 
and eval/(i^') are in different orders (also the feedback width is q rather than 
r). That the two expressions are still equal is the subject of another lemma. 
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Lemma 9.11. Let {V,{FA}AeB'^'j{t"'}nefi) PROP with formal feed- 
hacks. Let 



'All 

A21 A22 



B22 B23 
B32 -B33 



where A22 G B'"^'^ and B22 G B^^''' are such that A22B22 is nilpotent. Then 
for each a E Fa and b E Fb, 

(0(1'= ★ '"X"*) o a ® 0(r) o 0(1') ® 6 o 0(1' ★ "X''))r = 

= (0(1^= * «X"*) o 0(1'=) (g) 6 o a (8) 0(r) o 0(1' * "X«))t^. (9.15) 

Proof. This is a straightforward apphcation of the PROP with formal feed- 
back axioms. Conceptually, the steps are 




and in formulae (with a separate step for each axiom application) that reads 



1^= ^ "X™) o a ® 0(r) o 0(1') 6 o 0(1' ^ "X"))f = 
(0(l'=*"X")oa®0(r)o0(|'^'"X«)o0(|'*«X'^)o0(|')®6o0(|'^"X"))f 
= (0(1'= ★ '■X™) o a ® 0(1") o 0(1' ^ "X'') o 0(1' ★ r) 0(«X'')t''o 
0(1' ★ 9X"*) O 0(1') (g) 6 o 0(1' ★ "X"))f = 
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= (0(1'= * "X™) o a (g) 0(r) o 0(1' ^ "X'') o 0(1' * r ^ '?x'')t''o 

0(1' * ^X"^) o 0(1') o 6 o 0(1' * "X"))!" = 

= (0(1'= * "x*" * 1^) o a ® 0(r * 1^) o 0(1' * '"x^ ^ |9) o 0(1' * r * «x«)o 
0(1' ^ ''x™ * i«) o 0(1') ® b ® 0(i«) o 0(1' * "X" * i«))tT = 

= (0(1^= ^ '■+'?x™) o a ® 6 o 0(1' * "X'?+'') o 0(1' * r * '^X«))tT = 
= (0(l'=^r*'^X'') o0(|^'^"+«X™) oa®6o0(|'^"X'?+'^))tT = 

= (0(1^= * '?x™ ^ r) o 0(1^=) ® b ® 0(r) o 0(1'= ^ "x'^ ^ r) o 0(1'= * r * ^x")o 

0(i'=*'-x"*r) oa® 0(r*r) o0(i'^"x^*r))tT = 
= (0(1'= * ''x™) o 0(1'=) 6 o 0(1'= * "x") o 0(1'= * r * '^x")f o 

0(1'= * "X") o a ® 0(r) o 0(1' * "X«))f = 

= (0(1'= * <?x™) o 0(1'=) ® 6 o 0(1'= * "X") o 0(1'= * r) ® 0("X")f o 

0(1'= ^ "X") o a ® 0(r) o 0(1' * "X^))t« = 
= (0(l^*'?X™) 00(1'=) ®6o0(|'=*"X")o0(|'=^"X")oa® 0(1") o0(|'*"X'?))f = 
= (0(1'= * '?X'") o 0(1'=) ® 6 o a ® 0(1") o 0(1' * "X"))!^. 

□ 

It may be observed that although this is in one sense a stronger form 
of shding (the subexpression being shded can have external connections), 
in proving it the sliding axiom was only applied for 0('"X'^). Hence, in the 
presence of the other feedback axioms, the sliding axiom could (as is well 
known) be weakened to sliding of permutations. 

9.3 The free PROP 

What holds for networks typically has a counterpart for the free PROP. 

Corollary 9.12 (to Theorem ES]) • Let (P, {FjgeB'x., {t"}nGN) be a PROP 
with formal feedbacks. Let Q be an H"^ -graded set and f : Nw(fi) — > V be a 
PROP homomorpMsm. Let A= [^^ ^^^j ^ ^.x. ^ ^ |i2 j ^ ^.x. 

be such that An e B'=^', A22 G B^^^J B22 G B''^'', and ^33 G B™^"Vor some 
k, I, m, n,q,r G N. 

If A22B22 is nilpotent, then 

f{a n; 6) = (0(1'= ^ '^X"^) o f{a) ® 0(1™) o 0(|') ® f{b) o 0(|' ^ ^X'))f (9.16) 

for all a G y^iA) and b G 3^q(5). 
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Proof. By Theorem 18.41 every PROP homomorphism / from Nw(f2) is of the 
form evalg for g = Hence fl9.16l) follows from (19. lip for some K ^ a and 
H eb. □ 



Somewhat notable here is that it suffices for / to be a PROP homomor- 
phism; one need not assume that it respects the feedbacks, as those are 
sufficiently determined by the axioms anyway. This holds even though the 
free PROP is also a PROP with formal feedbacks. 

Lemma 9.13. For any N^- graded set, (Nw(r]), 3^q, {x</)(r)}„6N) is a PROP 
with formal feedbacks. 

Proof. Since a'\"' = a x 0(1") was used as template for the conditions about 
domain and range of a formal feedback, this is a straightforward matter of 
verifying the various axioms, to which end Theorem 18 . 1 1 and Lemma 17.21 are 
of great help. 

For tightening where a G Nw(f2)(i, j), b G Nw(fi)(j + n, k + n), and c G 
mi{n){k,l), one has after defining i = N,(0,6), j = Nj(l,6), k = Nfc(2,6), 
1 = N;(3, 6), n = N„(4, 6), and n' = N„(5, 6), 

(a ® 0(1") o 6 o c ® 0(r))r = K' I a]ht4]r = 

= (Gi I 4^ ffn' I K.]) X m = Gi I ajcfl X? {b X 0(1")) = 

= Gi I f I (br)i\ = G I a](6t")ica =aobroc. 

For superposing where a G Nw(fi)(i, j) and b G Nw(i7)(A; + n,l + n), one by 
Corollary EH] and after defining i = Ni(0,6), j = Nj(l,6), k = Nfc(2,6), 
1 = N/(3, 6), n = N„(4, 6), and n' = N„(5, 6) similarly has 

a®6t" = a N° (6 X 0(1")) = 

= (a N° 6) X 0(1") = £ I aj^a X 0(1") = (a ® b)r. 

For sliding a G Nw(f2)(m, n) past b G Nw(f2)(/c + ra, Z + m), the trick is to 
move a to the right operand of the symmetric join and back. After defining 
k = Nfc(0, 6), 1 = N;(l, 6), m = N^(2, 6), m' = N^(3, 6), n = N„(4, 6), and 
n' = N„(5, 6), one has 

(0(i'=)®ao6)r = [I'siic&ar = 

= K' I C'] (K I <] X & I 0(1")™]) = 
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= &IC] x™(&|c] X [n = 
= [in'l&Mr = (&o0(i')®a)r. 

For vanishing of feedbacks on a G Nw(f2) (k + m + n, I + m + n) , one similarly 
might want to define m = Nm(0,4), m' = N„(l,4), n = N„(2,4), and 
n' = N„(3,4). By Corollary EZB 

at"t" = ((a ^ZXn 0('^+"X"^+")) X (/)(r))t"' = 

/ rmnm'n' I il ..n fn I j / inN n'l \ \ 
« ^m+n ([m'n'mn | M [n' \ 4>[\ >n\))\ = 

a ^m+n [m'n'm | 0(1 )n J j ^ 0(1 ) = 

= a 1 0(i")n ] x;^ [^^, 1 0(r)^s']) = 

= a ^zx: & I mn<Pin^] = 

= a {<Pin ® 0(1")) = a 0(1"^+") = «r+" 

Vanishing also requires = a Nq 0(1*^) = a, which like the yanking identity 
0("'X")t" = 0("X") n" 0(1"-) = 0(1") is an immediate consequence of that 
same corollary. □ 

In order to show that a pullback f*Q to Nw(f2) of some order Q on a 
helper PROP V is preserved under symmetric join, the obvious approach 
which suggests itself is that one equips V with a (possibly formal) feedback 
and checks that Q is preserved under that. This works extremely well for 
PROPs with a cap-cup pair as in Theorem 19.41 for example the connectivity 
PROP and l-Lomv for finite-dimensional V , since the feedback is in that case 
just a PROP expression and any PROP quasi-order will therefore be preserved 
by the feedback. For other PROPs it may however get a bit roundabout, 
since setting up a formal feedback can be quite a bit of work. An alternative 
approach is to verify the following property, which may be more complicated 
to state but often is easier to prove. 

Definition 9.14. Let P be a PROP and Q be an N^-graded quasi-order on V. 
The relation Q is said to have the uncut property if for all /, m, m', n G N, 

all a G V{1, m + 1), 6 G V{m + 1, n), c G V{1, m' + 1), and d G V{m', n + 1) 
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it holds that 



a(g)0(i^) o0(r^ixi) 06® 0(1^) ^ c® 0(1^) o0(r'^ix^) od( 



(9.17a) 



imphes 



aob^codinQ. (9.17b) 

(In other words, the 'un-' in this 'uncut' has the same meaning as in 'undo'; 
one can go from the case where an edge has been cut to the case where 
is hasn't been cut.) Q is said to have the strict uncut property if the 
imphcation fl9.17p holds also if the ^ are replaced by <. 

It is for example straightforward to verify that the standard order on 
matrices has the uncut property. 

Lemma 9.15. Let {TZ,P) be an associative and unital partially ordered 
semiring, and let Q he the standard order on [TZ^o)'^* . Then Q has the 
uncut property. Furthermore, if P is cancellative then Q has the strict un- 
cut property on the sub-PROP of matrices which have at least one positive 
element in each row and column. 

Proof. The hypothesis fl9.17al) can be written in block matrix form as 



An 


Au 


0" 




7 





0" 




'Bn 


B12 


0" 






A22 













1 




B21 


B22 













1 







1 













1 









Cl2 


0" 




7 





0" 




"1^11 


D12 


0" 






C21 


C22 













1 




D21 


D22 





in Q 










1 







1 













1 





where the last two rows and columns have side 1. Performing these multipli- 
cations yields 

AiiBii A11B12 A12 
A21B11 A21B12 A22 
B21 B22 

or equvalently 

AiiBii A11B12 
_A2iBii A21B12 

and [B21 B22] ^ [D21 D22] in Q. 



Cii-Dii C11B12 C12 
^ C21-D11 C21-B12 C22 
D21 D22 



in Q, 



(9.18) 



Cii-Dii C11-D12 
C21-D11 C21-D12 



in Q, 



A12 
A22 



C12 
C22 



in Q, 
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Hence 



"All 


A12 




Bn B12 


A21 


A22_ 




B21 B22 





^ii-Bii A11B12 
_A2iBii A2iBi2_ 


+ 


'A12 

A22_ 






Cii-Dii C11-D12 
C21-D11 C21-D12 


+ 


C12 
C22 






Cll C*12 

C21 C22 




'/^ii 
D21 


D22 


in 


Q. 



'21 



B22] ^ 
D22] = 



For preservation of strict inequalities, one may observe that this is im- 
mediate from cancellativity if the strictness occurs within the first two row 
and column blocks of fl9.18p . If it occurs in the last column block {Ai2 versus 
Ci2) then 



^12 
^22 



[-B21 -B22] ^ 



^12 
^22 



[D2I D22] < 



C12 
C22 



[D21 D22] in Q 



because there is at least one positive element in the row [D21 D22]. Strict- 
ness in the last row block {B2j versus D2j) is similar. □ 

Corollary 9.16. The standard matrix order on Baff (7?.^o) O'lso has the uncut 
property, and if the partial order on TZ is cancellative then then the sub-PROP 
of matrices with at least one positive element in each row and column has the 
strict uncut property. 

Proof Let V = {TZ^o)"" and Q = Baff(7^^o)• Recall that Q is a subset of 
V. The tensor product and permutation operations in V are not the same 
as in Q, but a ®g (Pq{\^) = a ®p 0-p(l^) for all a G Q and 0Q(cr) = 0-p(l^ -k cr) 
for all permutations a, so any instance in Q of fl9.17p is also an instance of 
if it in V (although with I, m, m', and n all incremented by 2). □ 

Theorem 9.17. An N^-graded quasi-order Q on the free PROP Nw(r2) is 
preserved under symmetric join if and only if it is a PROP quasi-order which 
has the uncut property. Moreover it is strictly preserved under symmetric 
join if and only if it is a strict PROP quasi-order which has the strict uncut 
property. 

Proof. That a quasi-order (strictly) preserved under symmetric join is a 
(strict) PROP quasi-order was shown in Lemma I9.2[ The uncut property 
is a immediate consequence of being preserved under the symmetric join 
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mI 0(1^), as 

aob = ao 0(r ^ ^X^)f o 6 = (a ® 0(1^) o 0(r * ^X^) o 6 ® 0(l^))f = 
= (a ® 0(|i) o 0(r * ^X^) o 6 ® 0(|i)) 0(|i) ^ 

^ (c ® 0(1^) o 0(r' * ix^) o d ® 0(|i)) n} 0(|1) = 
= (c ® 0(1^) o 0(r' * ix^) o d ® 0(i^))f = 

= c o 0(r' ^ iX^)f od = codmQ 

for all a G Nw(i7)(/,m), 6 G Nw(i7)(m, n), c G Nw(fi)(/,m'), and d G 
Nw(fi)(m',n). 

That conversely any PROP quasi-order Q with the uncut property will 
be preserved under symmetric join can be shown using the formula fl9.16p 
for the symmetric join. Since Nw(f2) is a PROP with formal feedback and 
id: Nw(f2) — > Nw(f2) is a PROP homomorphism, it follows that 

a n; 6 = (0(1'= * "X*") o a 0(r) o 0(|') o 6 o 0(|' * "X"))t'' 

for a G Nw(f2)(fc + r, / + g) and b G Nw(i7)(g + m, r + n) such that the 
symmetric join exists. Obviously, if a ^ a' in Q and b ^ b' in Q then 

0(1'= ^ "X™) o a ® 0(r) o 0(1') ® 6 o 0(1' ^ "X") ^ 

< 0(1^= * "X™) o a' ® 0(r) o 0(1') ® 6' o 0(1' * "X") in Q 

since Q is a PROP quasi-order. Hence the wanted conclusion follows once 
it has been established that c ^ c' in Q implies cY ^ c'Y in Q for all 
c,c' G 3^n(C), where C = [g^^ g^^] G B'^' has C22 e B*-^^ nilpotent. 

By vanishing of feedbacks, this follows for all r once it has been shown for 
r = 1. Let G G c and G' G c' be arbitrary. Let / = u}{G) — 1 = uj{G') — 1 and 
n = a{G) — 1 = a{G') — 1. Let ei be the edge in G with tail 1 and tail index 
n + 1, and let cq be the edge in G with head and head index / + 1. Let Wq 
be the set of all inner vertices of G which can be the headwards endpoint of 
a path whose first edge is ei, and let Wi be the set of all other inner vertices 
of G. Then (Wq, Wi) is a cut in G and ei is by construction a cut edge, cq 
is also a cut edge, because the head of cq is 0, and had the tail of cq been in 
Wq then the (/ + 1, tt, + 1) position of Trf (G) = G would have been 1, which 
is impossible since G22 is nilpotent. Let m be the number of cut edges other 
than Co and ei. There is an ordering pi of the cut such that pi(eo) = m + 1 
and Pi(ei) = m + 2; let {Gq,Gi) be the corresponding decomposition of G. 
For po = {\"^-k^X^) opi, one has that [Wq, 0,po) is an ordered cut in Go, and 
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hence Go has a cut decomposition (Gqo, Gqi). From the choice of ordering of 
these cuts, one sees 

eval(G'i) = eval(ifi) (g) 0(1^) for some Hi e Nw(l])(m + l,n), 
eval(Goi) = 0(1'" ^^X^), 

eval(Goo) = eval(ifo) ® 0(1^) for some Hi e Nw(^])(/, m + 1). 

By applying the same argument to G', one gets some m' (which need not be 
equal to m), H^ G Nw(fi)(/,m' + 1) and H[ G Nw(il)(m' + l,n) such that 

c' = eval(i/^) ® 0(|i) o 0(r * ^X^) o eva\{H'i) ® 0(1^). 

Thus the uncut property applies to c ^ c' in Q, and it follows that c^^ = 
eval{Ho) o eval(i/i) ^ eval(if^) o eval(i/() = c't^ in Q. 

Replacing some ^ by < yields the similar argument for Q also being 
strictly preserved under symmetric join. □ 

One could in TZ'^* similarly argue that the uncut property implies preser- 
vation under feedback, but this implication need not hold in general PROPs; 
the tricky part is whether the fact that c is in the domain of t also gives rise 
to a decomposition of c as a® 0(1^) o0(|™^^X-'^) o6(g)0(|^). For our purposes 
here, it is however sufficient that it holds in Nw(fi), since that is what we 
primarily wish to order. For that end, a few results from Section [3] need to 
be extended to the uncut property. 

Lemma 9.18. Let V and Q he PROPs, and let f : V — > Q be a PROP 
homomorphism. If Q is a quasi-order on Q which has the (strict) uncut 
property then the pullback f*Q also has the (strict) uncut property. 

If P and Q are quasi-orders on Q which have the strict uncut property, 
then P oQ has the strict uncut property as well. 

Proof. Introduce the shorthand 

[/(a, m,h) = a® 0(1^) o 0(r ^ ^X^) o h ® 0(1^). 

For the first part, let /, m, m', n & a & m + 1), 6 G V{m + 1, n), c G 
P(/, m' + 1), and d G V{m' + 1, n) such that U (a, m,b) (c, m', d) in f*Q 
be given. Then by definition of pullback 

t/(/(a), m, /(6)) = f{U{a, m, b)) ^ f{U{c, m', d)) = U{f{c),m', f{d)) in Q 

and hence /(a o b) = f{a) o /(6) ^ /(c) o /(rf) = /(c o d) in Q, meaning 
aob ^ cochin f*Q. Replacing ^ in this argument by < then yields the strict 
uncut property. 
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For the lexicographic composition, one would instead let l,m,m',n G N, 
a e Q{l,m + 1), b G Q{m + l,n), c G Q{l,m' + 1), and d G Q{m' + l,n) such 
that U{a, m, h) < U{c, m', d) in PoQ be given. If this is because ?7(a, m, h) < 
U (c, m', d) in P then ao6<co(iinPby the strict uncut property of P, and 
thus aoh < cod'm PoQ. If this instead is because U{a, m, b) ~ U{c, m', d) in 
P and ?7(a, m, h) < U{c, m', d) in Q, then aofo^coc/^aofeinPby twice 
applying the uncut property of P and ao6<co(iin(5by the strict uncut 
property of Q, from which similarly follows aob<codmPoQ. Finally if 
a, b, c, and d instead satisfy U{a, m,b) U (c, m', d) m. PoQ then this holds 
separately in both P and Q, whence aob ^ co d m both P and Q as well, 
and thus it also holds in P o Q. □ 



10 Rewriting 

This section formally sets up a rewriting theory for free linear PROPs 7?.{f2}, 
finishing off with some Diamond Lemmas. It is convenient to let the coeffi- 
cient ring 71 and signature VL of 71{VL} be fixed throughout the section, so let 
TZ be an arbitrary associative and commutative ring with unit, and let VL be 
an arbitrary N^-graded set. 

The rewriting formalism used here will be that of [Sj. For the reader's 
convenience, elementary definitions of most concepts we shall employ are 
given below, whereas results are typically used without a precise statement 
being included here; instead there are detailed references. One thing to bear 
in mind is also that several of the more advanced "features" of the formalism 
in [5] , in particular the topological structure used to handle rewriting of power 
series and the like, are "deactivated" here since they are fairly orthogonal 
to the issues at hand and would unnecessarily clutter the presentation if 
included; "reactivating" these features should present no great difficulty for 
the interested reader, since most intermediate results below apply as they 
are written also in that more general setting. 

One feature of the rewriting formalism that we will most definitly have 
to "keep on" is that it is many-sorted, meaning it works with expressions 
of several different sorts. An expression of one sort always rewrites to an 
expression of the same sort, but a rewrite step may employ a rule that was 
primarily stated for some other sort, since the expression it is applied to has 
a subexpression of that other sort. Since what matters for the basic PROP 
operations are arity and coarity, one might expect that the sorts should be 
pairs (m, n) of natural numbers, but in fact a much finer separation will be 
made: the (index) set for possible sorts is the PROP of all boolean matrices 
B*^*. The set of expressions of sort q G B*^* is then the module M.{q) of 
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Definition 18.131 (It is not a problem that many elements of TZ{Q} belong to 
several of these modules, because when something is to be rewritten, it is 
formally being rewritten as an element of some specific M.{q).) 



10.1 Reductions 



Formally, the idea that some fi of sort r appears as a subexpression of some 
of sort q is taken to mean that u = v{fi) for some map f in a specific family 
V(g,r). 

Definition 10.1. For any q,r & M'^', let V{q,r) be the set of all maps 
v. Ai{r) — y -Miq) of the form v{b) = /i x 6 for some /i G y{p), where 
P = [plipll] is such that p22r is nilpotent and pu + Pi2f{p22f)*P2i ^ 9- 
Putting it differently, 



V(g,r) 



U 



P22T is nilpotent 



:io.il 



Lemma 10.2. The V(g, r) families of maps have the following properties: 

1. If q ^ r then the identity map id on Ai{r) is in V{q,r). This can be 
used to change the sort of an expression to something less specific. 

2. If Vi G V(g, r) and t>2 G V{p,q), then V2 o vi G V{p,r). Hence, V is a 
category. 

3. For any a G E^, r G and q G B™'^", the map a t— )■ </'7^{^7}(c") o a o 
<Pn{n}{'T') IS in V(0b«x.((t) o g o 0B.x.(r),g). 

4. For any A G 3^(]5) and v G i/ie map \ o aov is in V{pqr, q). 

5. For any A G 3^(p) and v G 3^(r), i/ie map ay^\®a®visin 
V{p ®q®r,q). 

Proof. For item[Tl let m = u{r) and n = a{r). Then a = 07^{n}C^X''") Nj^a by 
Corollary 18.111 so the wanted /i is 07^{n}("X™) having pu = 0, pi2 = 0(1™"), 
P21 = 0(1"), and P22 = 0. 

For item [2], let m = Ci;(r), n = a(r), /c = a;(g), and / = a{q). Then 
fi(c) = /ii c for some /xi G Nw(f2)(A; + m, / + n) and ^2(0') = /i2 nJ, c' for 
some /i2 G Nw(fi) [u{p) + k, a{p) + /) . More concretely. 



^22 ^24 
642 &44 



and 1^2 &y 



ail 0.12 

021 0-22 
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for some boolean matrices satisfying that 022^' and b^ir are nilpotent, an + 
ai2?(a22?)*'^2i ^ P, and 622 + &24'^(&44'")*&42 ^ 1- Nilpotence of 022^' imphes 
nilpotence of 022^22 + a22&24'"(&44'")*&42 and hence by Lemma 16. 101 the nilpo- 
tence of CI22&22 and (a22&22)*fl22&24'"(&44'")*&42- This fulfils the conditions for 
associativity of symmetric join (cf. Lemma 17.21) and hence 

V2{vi{c)) = /i2 (/ii c) = {fl2 ^i) N;;, C = (/i2 ^1) X C. 

By Construction 17. H 



1^2 xini ey 



Sii Si4 
S41 S44 



where 



Sii :— On + ai2fe22(c^22^22)*C^21 514 :— a,12(^22Q'22)*^24 
S41 := &42(fl22^22)*Q'21 S44 := 644 + 642Q.22(^22'3'22)*^24 

and it is convenient to also have the shorthand S44 = &42022(&22022)*&24- Then 
p ^ an + ai2g(a22g)*a2i ^ 

^ an + ai2g(^a22(&22 + &24?"(&44?")*&42)) ^21 = 

= an + ai2g(a22&22 + a.22&24'"(&44'")*&42)*a21 = 

= an + ai2g(a22&22)*(a22&24?^(&44r)*642(a22&22)*)*a21 = 

= an + ai2g(a22&22)*a21 + ai2g(a22fe22)* (a22fe24?^(&44r)*&42(a22&22)*)^a21 ^ 
> an + ai2(&22 + &24r(&44?^)*642) (a22&22)*a21 + 

+ ai2g(a22&22)*(a22fe24?^(&44r)*642(a22&22)*)^Ct21 = 
= Sn + ai2&24'^(&44'^)*&42(a22&22)*a21 + 

+ ai2g(a22&22)*(a22&24?^(&44r)*642(a22&22)*)*a22&24r(fe44r)*642(a22&22)*a21 
= Su + ai2&24'^(&44'^)*S41 + 

+ ai2g(a22&22)*a22&24r((644r)*642(a22&22)*a22&24?^)*(&44r)*S41 = 
= Sn + ai2b2ir{b4^4r)*S4i + ai2g(a22&22)*a22&24'"(&44'" + ■S44r)*S4i = 

= Sn + ai2b24.r{bur)*S4i + ai2g(a22&22)*a22&24?^(s44?^)*S4i ^ 
^ Sn + ai2b24.r{b44rys4i + 

+ a.l2&24'r(&44'")*&42(a22&22)*a22&24'"('S44'")*S4i + 

+ ai2&22(a22&22)*a22&24?^(s44?^)*S41 = 
= Sn + ai2&24?^((&44?")* + (&44'r)*S44r(644r + S44r)*)s4i + 

+ ai2(622a22)^&24?^(s44?^)*S41 = 
= Sn + ai2624?^(&44?^ + S44'')*'541 + CH2 (&22a22)^&24?^(s44?^)*S41 = 



159 



= sn + ai2{b22a22Tb24r{sMr)*S4i = 

= Su + Si4r(s44r)*S41 



and hence c (//2 ^kf^i) ^ meets all conditions for being in V{p, r). The 
full family {V(p, r) reB'x* ^^^^ fulfils the conditions for being a category: it 
contains identities by the previous point, and it is closed under composition 
(when domain and codomain matches). 

For itemU one may let k = N^(p)(0,4), 1 = N^(g)(l,4), m = N„(g)(2,4), 
and n = NQ,(r)(3,4). Then 

A o a o I. = [J^ I Xfal^u^] = [^^ \ X^u^] x a = (A ® o 0(-('')X°(p))) x a 

by Theorem Eini and A(g)z/o0("WX"(p)) G 3^ ([° p]), whichhas 0+pg(Og)*r = 
pgr ^ pgr as the definition of V requires. Item [3] is a special case of item |H 
For item [5l one may similarly let i = Nt^(p)(0,6), j = Nq,(p)(1,6), k = 
N^,)(2,6), 1 = N„(,)(3,6), m = N^(,)(4,6), and n = N„(,)(5, 6). Then 



X a 



and 



V 





r 





' 




where again 
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0" 
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g(Og)*[0 ( 
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^ j9 (g) g (g) r 
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r 





as required. 



□ 



Definition 10.3. A rewrite rule s for TZ{Q} is a triplet {gs, fj^s,cis), where 
gs e B*^* is the transference type of the rule, fig £ yiQs) is the left hand 
side of the rule, and G M.{gs) is the right hand side of the rule. A 
rewriting system S for TZ{Q} is a set of rewrite rules. 

A rewrite rule s is said to be sharp if g<. = Trflfig), and a rewriting 
system is sharp if all its rules are sharp. 

A practical and convenient style of writing rewrite rules is that used in 
(11.11) and (II. 2p . but it may be best to explain in detail how it is meant to be 
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interpreted. First, the left and right hand sides of a rule s are given in naked 
abstract index notation, roughly as a formula on the form 

k 

where {rjjjLj^ C TZ whereas M and the Ai are notational products on the form 
Y[\'=ii^i,j)v]',j and each Xij G f2(||ujj|| , ||vj U {6} (where the Kronecker 6 
is taken to have arity and coarity 1; it is essentially the same as the t] used in 
Section [8j). For this formula to be well- formed, each Ai must have the same 
unmatched indices as M; let h = bi ■■■ bm and c = ci ■ ■ ■ be lists such that 
|b| is the set of unmatched superscripts in M and similarly |c| is the set of 
unmatched subscripts. Then in closed abstract index notation, 

k 
i=l 

The meaning of a 'where bi r\ Cj clause is that has a in the (i, j) position; 
in the typical case most outputs have a dependence on most of the inputs, so 
it tends to be more compact to list those entries that are than those that 
are 1. 

One thing that this style of writing a rule does not specify is the order 
in b and c of the unmatched indices, but that turns out to be irrelevant for 
the reduction steps that the rule can give rise to, mostly because of item [3] 
in Lemma [1U.2I 

Definition 10.4. A simple reduction of type p G B*^*, with respect to 
the system 5, is an 7^-linear map t^y. A^(p) — > M.(j)) (7^-module homo- 
morphism) satisfying 

= (';'"'' «^ = "("•). fo.allAe>.(p). (10.2) 

I A otherwise 

where s G 5* is some rule and v G V(p, gs). Denote by Ti(5')(p) the set of 
all simple reductions of type p with respect to 5*. A reduction (of type p, 
with respect to 5) in general is a finite composition of zero or more simple 
reductions (of type p, with respect to S*). Denote by T{S){p) the set of all 
reductions of type p with respect to S. 

By Lemma 7.3], all the V-maps satisfy the technical condition of being 
advanceahle [SI Def. 6.1] with respect to Ti{S)\ for all p,q E M'^*, t G 
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Ti{S){q), fi G y{q), and v G V{p,q) there exists some t' G T{S){p) such 
that t'{v{fi)) = v{t{fi)). They are in general not absolutely advanceable 
however, since the symmetric join with one factor fixed need not be injective: 
if ?7 G 0) and e G fi(0, 1) then for /i = rj^rjoe^e one finds /i x ^("'^X-'^) = 
{e o T]) ® {e o rf) = li yi 0(1^). 

Definition 10.5. Let S" be a rewriting system for TZ{Vt]. A reduction t G 
T{S){q) is said to act trivially on some a G A^(g) if t{a) = a. An element 
a G M{q) is said to be irreducible (with respect to S and q) if all t G 
T{S){q) act trivially on it. The set of all irreducible elements in Ai{q) is 
denoted lrr(S')(g). Also let 

AS){q)= J2 {a-t{a)\aeM{q)} (10.3) 

and write a = b (mod S) for a — 6 G ^{S){J^(^a)xa{a)), where Jmxn denotes 
the m X n matrix of ones. An a G lrr(S')(g) is said to be a normal form of 
b G Miq) ifa-beIiS){q). 

By Lemma 3.5 of [5J, lrr(S')(g) is an 7?.-module and an alternative defini- 
tion of it is 

lrr(5)(g) = {beM{q)\ t{b) = b for all t G Ti{S){q) } , 

i.e., it is sufficient to consider simple reductions. Under (a subset of) the 
conditions in the Diamond Lemma, it furthermore holds that 

lTT{S)iq) = Span(3;(g) \ {^^(^s)},,^^,.),..^) (^O-^) 

by Theorem 5.6 of [S]. Therefore it in general becomes interesting to seek 
positive descriptions of the complement of the set of those networks which 
are right annexations of one of the rule left hand sides (in the terminology 
of formal language theory, one might wish for a generative description of the 
complement of the language of networks which have one of the left hand sides 
as a subnetwork). 

Note that it does not necessarily follow from a = b (mod S) for some 
a,b E Ai{q) that a — b E I{S){q) if q is not a matrix of ones. The typical 
situation in which this happens is that there is a proof that a is congruent to 
b modulo S, but some intermediate step in this proof requires a transference 
strictly larger than q, even though a and b by themselves do not. 
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Example 10.6. Suppose u G Q{0,2) and n G Q{2,0). The zig-zag identities 
for these may then be expressed as the rules 

si = (Jixi, g|ui2n23],0(|i)), 

S2= (Jlxl, g|n32u2l],0(l^)). 

These make [3 | Ui2n^'^] = [3 | n^^U2i] (mod {si,S2}), since 

[I I ui2n^^] - [I I n^^U2i] = [I I ui2n^^] - 0(1^) + 0(1^) - [I \ n^^U2i] = 
= (id - tid,s J ( [3 I ui2n''] ) - (id - tid,s J ( [3 I n''u2i] ) G X({si, S2}) ( Jixi), 

but [I I Ui2n23] - [1 I n'^^U2i] ^ X({si, S2}) (0). Demonstrating this latter point 
is not quite trivial — one would like to make use of the Diamond Lemma 
for that — but it is straightforward at this point in the exposition to show 
that [3 I Ui2n^^] — [3 I n^^U2i] G lrr({si, S2}) (0), which together with (c) of 
Lemma [inSH yields the ^ X({si, S2}) (0). 

Considering first the problem of whether there exists some simple reduc- 
tion t^^s G Ti ({si, S2}) (0) which acts nontrivially on [3 | Ui2n^'^], one may 
look for an embedding of some H E into G = Nw(3 | Ui2n^^), and the 
vertex part of such an embedding is fixed by the decorations. There is no 
way to embed H2 = Nw^g | n'^^U2i) into G however, as in H2 the second 
out-edge of the n vertex and the first in-edge of the u vertex are the same, 
whereas in G they are distinct. Hence the possibility that remains is s = Si, 
and since G G fisi it is pretty obvious that there is such an embedding — the 
identity (id, id) — and since the mapping of the vertices is fixed and there are 
no isolated edges in these networks, that is the only embedding there is. The 
lack of isolated edges also imply that there is only one strong embedding, 
and thus the only way of writing [3 | Ui2n^^] as a right annexation of some 
/is- is [3 I Ui2n^^] = 0(^X^) X fis^. There is however also the matter of the 
transferences to consider, g^-^ = (1) and Trf(0(^X^)) = (io)> which means 
V G V{p, qsj such that v{b) = 0(^X-^) x b only exist for p ^ 1 ■ ■ 1 = Jixi- 
Hence that t^,,, ^ Ti ({si, Ss}) (0), and | Ui2n23] g Irr ({si, Ss}) (0). The 
situation for the other term [3 | n^^U2i] is completely analogous. 

The following lemma corresponds closely to Lemma 3.7 and Corollary 3.9 
of [5], but the differences in context warrant an explicit proof here. 

Lemma 10.7. Let S be a rewriting system for TZ{Q}. The = (mod S) 
relation is an TZ-linear PROP congruence relation on TZ{VL]. 
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I{S){q) is an TZ-module for every q G B*^*, and ker t C X[S){q) for every 
t e T{S){q). For every v G V(g,p) it holds that p{v){l{S){p)) C I{S){q). 
Furthermore any b G X{S){p) can he written as 

n 

b = ^riVi{fis,-as,) (10.5) 

i=l 

for some n G N, {ri}^^^ C TZ, {si}"^i C S, and vi G V(p, gsj fori = 1, . . . , n. 

Proof. Let t G T{S){q) be arbitrary. For any b,c ^ -M-lq) and r E TZ one 
finds that 

(6 - - (c - t(c)) = 6 - c - t{b) + t(c) = 

= (6 - c) - t(6 - c) G [a- t{a) \ a e M{q)] , 
r[b - t{b)) =rb- t{rb) G { a - t{a) \ a G M{q) } 

and hence Nt := {a — t{a) | a G A^(g) } is an 7^-module. Obviously the sum 
of a family of 7^-module is an 7?.-module, so Z{S){q) is an 7^-module. From 
the similar observation that any a G kert satisfies a = a — t{a) E 'O 
X(5)(g), it follows that kert C I{S){q) for t G T{S){q). 
Next, it will be shown that 

AS){q)= Yl (10.6) 

i.e., it is sufficient to let t range over the simple reductions. Clearly is 
just {0}, and thus does not contribute anything unique to I{S){q). Any 
other nonsimple reduction t G T{S){q) is a finite composition t„ o ■ ■ ■ ot^ = t 
of simple reductions ti, . . . ,tn G Ti{S){q) and it holds that Nt C Ylk=i ^tk^ 
because if = t^ o ■ ■ ■ o ti for k = 1, . . . ,n then any a — t{a) G Nf can 
be written as a — ti(a) + Ui{a) — t2[ui{a)) + ■ ■ ■ + M„_i(a) — tn[un-i{a)) G 
Nt^+Nt^ + --- + Nt„. Hence EteT(5)(<?) ^ EteTi(5)(g) ^he terms for 
simple reductions suffice for producing the total sum. 

By definition, the only element of y{p) that a simple reduction ^ G 
Ti{S){p) acts nontrivially on is w{^s), so 



{a - t^,s(a) I a G A^(p) } = I rw(/i^) - t^^s{rw{fis)) 



r en 



r en 



Thus any b G X(S')(p), which by (110.61) can be written as a sum of such 
a — tu!,s{o,), is therefore also as claimed in (110. 5p . Now let q G B'^* and 
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V G V{q,p) be given, v o Vi E V(g, qi) by Lemma riU.2[ so 



^i=l ^ 1=1 

n 

i=l 

Finally consider = (mod S). It is congruent under addition by definition, 
and congruent under multiplication by a scalar since I{S){q) is an 7^-module; 
the latter also makes it reflexive, transitive, and symmetric. Being congruent 
under composition and tensor product is by items H] and [5] of Lemma 110.21 
merely special cases of being congruent under all v G V{Jmxn, Jkxi), and it 
was shown above that any v G V{q,p) maps X{S){p) into Z{S){q). □ 

Definition 10.8. An a E Ai{q) is said to be uniquely reducible (with re- 
spect to S and q) if for any ti,t2 £ T{S){q) such that ti{a),t2{a) G Irr(5')(g) 
it holds that ti{a) = t2{a). An a G M{q) is said to be persistently re- 
ducible (with respect to S and q) if there for every ti G T{S){q) exists some 
t2 G T(S){q) such that t2{ti{a)) G Irr(S')(g). The set of all elements of Ai{q) 
that are uniquely and persistently reducible is denoted Red(5')(g). Denote 
by tq, or just if q is known from context, the map Red(S')(g) — > Irr(S')(g) 
with the property that there for every b G Red(S')(g) is some ti G T{S){q) 
such that tg(&) = ti{b), i.e., t^{b) is the element of Irr(5')(g) to which b can 
be mapped by a reduction ti G T{S){q). 

By Lemma 4.7 of p], Red(S')(g) is a submodule of J^{q) and is an 
7^-linear projection of Red(S')(g) onto Irr(S')(g) with kert^ C Z{S){q). 

10.2 Ambiguities 

Clearly, an obstruction to unique reducibility must take the form of some- 
thing that can be reduced in two different ways. That reductions are defined 
to be maps of a specific form immediately allows the concept to be slightly 
specialised. 

Definition 10.9. Let q G B*^* and a rewriting system S for TZ{Q} be 
given. A type q ambiguity of S* is a triplet (ti, /i, ^2), where ti, t2 & Ti{S){q) 
act nontrivially on /i G y{q); the ambiguities (ti,fi,t2) and (t2,fi,ti) are 
considered to be the same. The n part is called the site of the ambiguity. 
An ambiguity (ti,/i,t2) is said to be resolvable if there exist reductions 
t3,t4 G T{S){q) such that h[ti{n)) = tA{t2{n)). 
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Every rule s gives rise to a trivial ambiguity (tid,s, yUs, ^id,s) of type g^. 
Since ^1 = ^2 = ^id,s; these ambiguities are also trivially resolvable. Not all 
self-ambiguities are trivial, however. 

Example 10.10. Suppose m G Q{1,2) and consider the rule 

s= (^Jix3, m ° 0(1^) ® m, m o m (g) 

this rule can be used to express associativity (if m is the symbol for the 
multiplication operation, then it changes a product a{bc) to (a6)c). The 
rewriting system {s} has the type Jix4 ambiguity 

ft I mM f ^ 

where, keeping in mind that | m^'grrigs] = fig = [l^"^ \ ^tb'^u]^ 

viib) = [lllf I ml] X b and v,{b) = []llf \ ml,] x b. 

This ambiguity is resolvable in {s}, but not trivially so; the steps of the 
resolution make up the "associativity pentagon". (Figuring them out is a 
good exercise; a tip is to employ network notation for these calculations.) 

That all ambiguities of a rewriting system are resolvable is sometimes 
called the diamond property (hence 'Diamond Lemma'), but more commonly 
local confluence. Ordinary confluence is rather that all elements of TZ{Q} 
are uniquely reducible. Not all ambiguities are resolvable, not even self- 
ambiguities. 

Example 10.11. Suppose x, y G i7(l, 1) and consider the rule 

si = (</ixi,y oy,0(l^) -xox); 

this rule can be viewed as encoding the congruence xox + yoy = (f){\^) 
(mod {si}), which is the defining equation of the basic noncommutative cir- 
cleJll The rewriting system {si} has the type Jixi ambiguity 

(^^.l,sl,y oy oy,t^2,si) 

where Vi{b) = boy and V2{b) = yob. In this case, t„^,s-^(y oy oy) = y — xoxoy 
and tt,2,si(yoyoy) = y — yoxox are both in Irr({si}) (Jixi), so the ambiguity is 

In noncommutative algebraic geometry, a 'noncommutative circle' is an associative 
algebra generated by two generators x and y satisfying an equation whose commutative 
counterpart is + = 1. Clearly + = 1 is such an equation, but so is x'^ + rxy — 
ryx + 2/^ = 1 for any value of the scalar r, and the resulting algebras are not the same. 
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not resolvable. The calculation does however demonstrate that y — xoxoy = 
y — yoxox (mod {si}), or equivalently xoxoy = yoxox (mod {si}), which 
suggests it might be a good idea to add the rule S2 = (Jixi, yoxox, xoxoy) 
to one's rewriting system, as doing so will render this ambiguity resolvable 
without changing the congruence relation. 

It is not too hard to see that every rule is formally involved in infinitely 
many ambiguities, but there are only a few that one actually need to consider. 

Definition 10.12. Let {tvi,si, [G]:^,ty^^s2^ be an ambiguity. Fix some Hi E 
and H2 G [Aisa]^^- For i = 1,2, let (xiyi'i) be the embedding of Hi 
in G that corresponds to Vi. Write (Vg, Eq, he, gctc, sg, Dq) = G and 
(Vi, Ei, hi, Qi, ti. Si, Di) = Hi for i = 1,2. The ambiguity is said to be terse if 
all of the following hold: 

1. Vg = {0, 1} U imxi U imx2- 

2. Eg = im-i/'i U im-?/'2- 

3. p(V'i)(p(^i)({0})) and ^(^'2) (p(t2)({l})) are disjoint. (I.e., no edge of 
G is simultaneously the image of an output leg of Hi and an input leg 

of H2.) 

4. p{ipi)[p{ti){{l})) and p{i^2){p{h2){{0})) are disjoint. (Ditto, but in- 
put leg of Hi and output leg of H2.) 

5. For any e, e' G Ei such that ipi{e) = ipi{e') ^ iinip2, ^i(e) = 0, and 
ti(e') = 1 it follows that e = e'. 

6. For any e, e' G E2 are such that ^/'2(e) = 4'2{g') ^ imipi, h2{e) = 0, and 
^2(e') = 1 it follows that e = e'. 

A type q ambiguity {t, n, u) is said to be a shadow of the type p am- 
biguity {t',n',u') if there exists some v G V{q,p) such that = v{^'), 
t{n) = v(t'{jj')), and «(//) = v[u'{jj,')). 

Conditions [Hand [2] alone imply that a given pair of rules are only involved 
in finitely many terse ambiguities, which is of great theoretical importance 
as it demonstrates various operations of importance for completion are ef- 
fective. Conditions HHS] (and also conditions EHc] of Lemma 110. 15p are rather 
conditions that serve to eliminate branches from the search tree one would 
traverse when enumerating all relevant ambiguities; this is helpful for actual 
computations. What says non-terse ambiguities need not be considered is 
primarily the following lemma. 
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Lemma 10.13. Let S be a sharp rewriting system for TZ{Q} . Then every 
ambiguity of S is a shadow of a terse ambiguity of S. 

Proof. Let (t„i,si, [GJ^, t^jj^^j) be an arbitrary ambiguity. Fix some Hi G 
[fisi]~ and H2 G [/^sa]^- For i = 1,2, let (Xiyi^i) be the embedding of Hi 
in G that corresponds to fj. Write (Vg, Eq, ho, gctc, ^g, Dq) = G and 
(Vi, Ei, hi, gi,ti. Si, Di) = Hi for i = 1,2. The idea for this proof is to view 
each instance in which this ambiguity violates a terseness condition as an 
opportunity to peel away some part of the ambiguity — explicitly producing 
some suitable G' between G and the Hi, and then using Theorem 18.171 to 
factorise Vi and V2 at [G"]~. Through a finite number of such steps, each 
producing a new ambiguity which has the previous as a shadow, one arrives 
at an ambiguity which fulfils all of the conditions. Since the rules are sharp, 
the type of the ambiguity at can always be taken as low as Trf(G"). 

Beginning with condition [H one may notice that if u G Vg'\{0, l}\imxi\ 
imx2 then (xi,"^!) and {x2,i^2) are embeddings also into 

G' = {Vg \ {u}. Eg, h', g', t', s', DG\va\{o,i,u}) 

where 

ihG,9G)ie) if /iG'(e) 7^ M, 

{0,tuiG)+gG{e)) ii hG{e) = u, 

(^G, ■SG)(e) iftGie)y^u, 
{l,a{G) + SG{e)) iftG(e)=M. 

Moreover [6*]^ = u >i for u = 0("(<^)X'^'^'^)) ®Dg{u) and the correspond- 
ing embedding of G' into G is (id, id), so the conditions for two applications of 
Theorem 18 . 1 71 are fulfilled; it follows that there are z/i, z/2 G Nw(f2) such that 
on one hand = z^i x = 1^2^ /^S2 5 and on the other Vi{h) = x (z/i x 6) 
and V2{h) = i/ x (z/2 x 6). Hence for v'i{h) = vi y\ h and v'2{h) = U2 xi b one 
sees that the ambiguity {ty-^^si, [G]~,tv2,s2) is a shadow of {tv[,si, [G']~,ty'^^s2) ■ 
Since G only has finitely many vertices, this step can only be repeated a 
finite number of times. 

Next, if condition [T] holds but condition [2] is violated then any cq G Eg \ 
imipi \ im1p2 must have hG^eo) = and tG{eo) = 1, since any other vertex is 
in im xi or im X2 and any edge incident to such a vertex is therefore in im ipi 
or imijj2 respectively. Hence 

G' = {Vg, Eg \ {co}, hG, g', tG, s' , Dg) 



{h\g'){e) = 
{t',s'){e) = 
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is a network, where 



9'{e) 



s'(e) 



gcie) if hcie) 7^ or gde) < gcieo), 

gcie) - 1 if hcie) = and gde) > gcieo) 

scie) if tcie) ^ 1 or scie) < sdeo), 

scie) - 1 if tcie) = 1 and scie) > scieo) 



for all e G -Eg \ {^o}- (Xi; ^0 is an embedding of Hi into G' for i = 1,2, and 
(id, id) is an embedding of G' into G, which goes with [G]^ = 0((t) x [G"]~, 
where a{j) = uj{G)+j for j < sdeo), o-(sG(eo)) = 5'G(eo), o-(j) = w(G')+j-l 
for SG(eo) < j ^ a(G'), o-(j) = j - «((?) for a{G) <j< a{G) + gcieo), and 
c"(i) = i ~ Oi{G) + 1 for «((?) + 5'G(eo) ^ j- Another two applications of 
Theorem 18.171 then yield vi,V2 ^ Nw(f2) such that on one hand = 
^1 X /Wfii = z/2 X /Xs2 5 and on the other Viip) = (j){a) x (z/i x 6) and f2(&) = 
0(cr) X (z/2 X 6). Hence for v[{b) = z/i x 6 and v'2{b) = i>2 xi b one sees that 
the ambiguity {tvi,si,[G]^,ty^^s^) is a shadow of ,si, V • Since 
ii^G \ ini'?/'! \ im?/'2 is finite, this step can only be repeated a finite number of 
times, and it preserves condition [H 

In order to see that the remaining steps likewise can only be repeated 
a finite number of times, one may observe that they decrease the number 
of distinct quadruplets {e,i,f,j) such that i,j G {1,2}, e G Ei, f G Ej, 
and ipiie) = 'ipjif), which obviously starts out finite. Moreover, these steps 
preserve conditions [T] and [2l 

When condition [3] is violated by the ambiguity, then a smaller ambiguity 
of which it is a shadow can be exhibited by cutting an edge. Let ei G 
p('?/'i)(p(/ii)({0}))np(-?/'2) (p(^2)({l})) and let 62 = l+max^G; after cutting, 
ei will be above the cut and e2will be below it. Let 

G' = {Vg, Eg U {62}, h', g', t', s', Dg) (10.7a) 

where 

(t',/)(e)= , (10.7b) 

^ ^ \(l,a(G) + l) if e = e2, ^ ^ 

{{hG,9G){e) iieeEG\{ei}, 
{h',g'){e)= l{Q,uj{G) + l) ife = ei, (10.7c) 
[(^G,5'G)(ei) ife = e2. 

Here [G]^ = v y\ for v = 0(°('^)X'^('^) 1^), and the corresponding 

embedding of G' into G maps ei and 62 both to ei, whereas everything else 
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is mapped injectively to itself. (xi^V'i) and (X25 "^2) are not embeddings into 
G' in this case, but the shght modifications (xi)V'i) and (x25V'2) defined by 

if '>pi{e) 7^ ei or hi{e) = 0, 
otherwise 

if ^/'2(e) = ei and t2(e) = 1, 
otherwise, 

are, and compose with the embedding of G' into G to yield their unprimed 
counterparts; the idea is to map elements of p{ipi) {{^i}) to ci and elements of 
p{ip2) ({^i}) to 62, unless forced to do the opposite by an edge endpoint which 
is an inner vertex. Hence there are by Theorem 18. 171 t^i . 1^2 G Nw(f2) such that 
on one hand [G"]~ = i^i x fisi = z>'2 x /^S2? and on the other vi{b) = 1/ xi (z/i x 6) 
and V2{b) = z/ x (z/2 x Hence for v[{b) = z^i x 6 and V2{b) = 1/2x1 b one sees 
that the ambiguity [Gj^, t^j^^j) is a shadow of {tv[,si, t^^^^sj) . At 

least one output leg of Hi and input leg of H2 form a quadruplet at ei in G 
but do not do so in G', since ip2 niaps the input leg in question to 62 whereas 
V'l map the output leg in question to ei. For condition H] the argument is the 
same, only with the roles of Hi and H2 reversed. 

If condition O is violated then the situation is basically the same — a cut 
can be made between two segments of an edge — but one has to proceed a 
bit differently since the embedding ipi does not contain enough information 
to tell which of e and e' is above the cut. Let 61 be the subdivision index 
map for edges associated with the homeomorphism to G from some Ki x Hi 
such that Vi{b) = [Ki]^ x b. It may without loss of generality be assumed 
that 6i{2e + 1) < 6i{2e' + 1), or in words that e is above e', since if it's the 
other way around then it must also be the case that /ii(e') = and ti(e) = 1. 
Therefore one may let ei = ipi{e), 62 = l + maxE'c, and again define G' using 
(110. 7p . No edge of H2 is mapped to ei, so (x2,V'2) is also an embedding of 
H2 into G'. An embedding of Hi into G' is where 

^, ^ U2 if Mf) = ei and 9i{2f + 1) > 9i{2e + 1), 
otherwise. 

Both compose with the usual embedding of G' into G to yield the original 
embeddings of H2 and Hi respectively into G, so by Theorem 18 . 1 71 there are 
z/i, z/2 G Nw(f2) such that on one hand [G"]~ = z/i x /x^^ = 1/2 x fig,^, and on 
the other [G]^ = z/ x [G"]~, Vi{b) = z/ x (z/i x 6) and V2{b) = z/ x (z/2 x 6). 
Hence for v'i{b) = z/i x 6 and V2{b) = z/2 x 6 one sees that the ambigu- 
ity {tv^,si,[G]~,ty^,s2) is a shadow of [G"]::,, ^^^J . (e, l,e', 1) was a 
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quadruplet with respect to G but not with respect to G' . For condition E] the 
argument is again the same, only with the roles of Hi and H2 reversed. □ 

That condition |5] above completely excludes edges in the image of ip2 is 
in part because not having to worry about %l)2 simplified the argument. The 
other reason for stating it that way is that instead having il)i{e) = ipi{e') G 
im '02 would lead to a situation being covered by at least one of conditions [31 
m and|b] (of Lemma [10. 151) . The situation for condition [H] is similar. 

Terseness is a condition that is practical to look for, but also one whose 
definition relies entirely on the way that Nw(f2) is constructed. The generic 
machinery of [5] is rather stated in terms of the shadow relation alone, making 
use of the fact that this is a quasi-order. 

Definition 10.14. Let A and B be ambiguities, and write A ^ B in Q if A 
is a shadow of B. Then A is a proper shadow of B if A > B in Q, and 
B is shadow-minimal if it is minimal with respect to Q. An ambiguity A 
is said to be shadow-critical if there is no shadow-minimal ambiguity B 
of which A is a proper shadow. Two ambiguities A and B are said to be 
shadow-equivalent if A B in Q. 

A type q ambiguity {tv^^s^_, 1^,^^2,32) of ^ is said to be a montage of the 
rules Si, S2 £ 5" if there is some v G V(g, ^132) such that Vi{h) = v{b^fis^) 
for all b e M{qs^) and V2{b) = v{^s-^^ ® b) for all b G M{qs2)- 

An ambiguity that is shadow-critical and not a montage is said to be 
critical. An ambiguity that is terse and not a montage is said to be decisive. 

The 'critical' here is the same as in 'critical pair', and 'critical ambiguity' 
is pretty much the same as what in rewriting in general is captured by the 
concept of critical pair. Note, however, that even if the essence is generally 
the same, what is formally defined to be a 'critical pair' can vary considerably 
between different branches of rewriting. The 'decisive' concept is another 
approach to more concretely formalise the same essential idea, but there are 
some subtle differences; see the technical discussion in the next subsection. 

Lemma 10.15. Let {tvi,si, [CJ^, t^jj.sa) be a terse ambiguity. Fix some Hi G 
and H2 G [/isa]^- -^'^^ ^ — 1)2, let {xi,'^i) be the embedding of Hi 
in G that corresponds to Vi. Write (Vg, Eq, he, gaytc, sq, Dq) = G and 
{Vi, Ei, hi, gi, ti, Si, Di) = Hi for i = 1,2. If the ambiguity is decisive then at 
least one of the following must hold: 

(a) There is some m G im xi fl im X2 ■ 

(b) There is some ci G Ei with hi{ei) = 0, ti(ei) = 1 and some 62 G E2 
with hi{e2) 7^ 0, ^2(62) 7^ 1 such that ipi{ei) = iIj2{^2)- 
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(c) There is some Ci G Ei with hi{ei) ^ 0, ti(ei) 7^ 1 and some 62 G E2 
with hi{e2) = 0, ^2(62) = 1 such that ipi{ei) = ip2{^2)- 

Proof. For the contrapositive, assume that none of condit ions [^-[c] are fulfilled, 
and seek to show that the ambiguity is a montage. It then follows that 
not only imxi and imx2 are disjoint (directly by the negation ofnj), but 
also that imipi and im'?/'2 are disjoint. The main reason for this is that an 
endpoint of an edge ipi^ei) in G can be covered by at most one of (xbV^i) 
and {x2,'^2) since imxi and imx2 are disjoint. Suppose first /ii(ei) 7^ — 
then any 62 G E2 with 4'2{g2) = V'i(ei) must have /i2(e2) = and thus violate 
terseness condition H] unless ti(ei) 7^ 1, but that would force ^2(62) = 1 and 
thus fulfil condition [cl Supposing instead that /ii(ei) = 0, any 62 G E2 with 
V'2(e2) = ipi{ei) not violating terseness condition [3] must have ^2(62) 7^ 1 and 
hence ti(ei) = 1 — then /i2(e2) = will violate terseness condition H] and 
^2(^2) 7^ will fulfil condition |bl Thus im?/^i and imilj2 are indeed disjoint. 

This means /iG(V'i(ci)) = for all Ci G 'p(^i)({0}) and /iG(V'2(e2)) = 
for all 62 G p(^2)({0}). Hence there is a permutation a G Stj{G) such that 
{a o go o ipi){ei) = gi{ei) for all ei G p{hi){{0}) and {a o qq o i)2){e2) = 
u){Hi) + (72(62) for all 62 G 13(^2) ({0}). Similarly there is a permutation 
T £ Sa(G) such that (r^^ 05^° V'i)(ei) = Si(ei) for all ei G |3(ti)({l}) and 
(r^^ o sg o ■?/'2)(e2) = a(-f^i) + ^2(62) for all 62 G p(t2)({l})- Hence a ■ G - t 
has the split (im?/^i, im'?/'2, iniXi? 1111X2)5 and [G]^ = (t){cr^^) o [Hi]^ [if2]~ o 
0(r-^). Thus vi{b) = (j){a-^)ob0fXs2°<P{r~^), V2ib) = (f){a-^)ofi,^^bo^{T-^), 
and the ambiguity is a montage. □ 

The various conditions ([IHS] and HHc]) introduced above make a good job 
of restricting the set of ambiguities that are considered, but it should be 
pointed out that there is one more source of multiplicity that are addressed 
by neither criticality nor decisiveness: permutation of inputs and outputs. It 
is immediately clear that two ambiguities which differ only in the order of 
their legs are shadow-equivalent (by item [3] of Lemma 110. 2p , but it is very 
hard to provide a general condition that would select just one representative 
ambiguity for each equivalence class. On the other hand, it is in a concrete 
situation typically straightforward to select representatives, so that matter 
is no big deal. 

Example 10.16. Continuing with the reduction system {s} considered in 
Example 110. 10[ one may conclude from condition [1] that a terse ambiguity 
can have at most four inner vertices in its site, and in combination with 
condition [a] (neither |b] nor |c] can be fulfilled since fig has no stray edges) that 
bound can be lowered to three inner vertices for sites of decisive ambiguities. 
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A practical way of finding all decisive ambiguities of {s} is then to start 
with Hi = Nw(7^^ I (2: m)j'g(3: 1x1)25) ^ and consider all the ways this Hi 
could be extended to some G (i.e., the embedding has xi = id) such 

that [G]~,t„2,s) is a decisive ambiguity. Taking also H2 = Hi, an initial 
tripartition of the search space is as follows: (i) it may be that 2 ^ imx2 
(the bottom vertex of Hi is not identified with any vertex of H2), (ii) it may 
be that 2 = ^2(2) (the bottom vertex of Hi is identified with the bottom 
vertex of H2), or (iii) it may be that 2 = x(3) (the bottom vertex of Hi is 
identified with the top vertex of H2). In case (i) it follows that 3 G imx2, but 
X2(3) = 3 would force ^2(2) = 2, so it must be the case that ^2(2) = 3 and 
G ~ Nw(^| (2: m)Je(3: m)^5(4: m)^ for some list a with |a| = {1,2,3,4}. 
Up to the order of the input legs, this is the ambiguity that was considered 
in Example IIU.IOI so that has already been dealt with. 

In case (ii), it follows that x(3) = 3 and G ~ ifi = H2, so this is the trivial 
ambiguity. In case (iii), one arrives at G ~ Nw(g | (2: m)[g(3: 111)25(4: 111)97) 
for some list a with |a| = {9,1,2,5}. This is the same ambiguity as in 
case (i), with the roles of Hi and H2 exchanged. Hence the ambiguity of 
Example 110.101 was (up to symmetry) the only nontrivial decisive ambiguity 
of {s}, and thus the only one that requires an explicit resolution. 

10.3 The Diamond Lemma 

The last order of business before the diamond lemma can be stated is to link 
rewrite rules and ambiguities to quasi-orders on Nw(fi). 

Definition 10.17. Let P be a quasi-order on Nw(fi), q G B*^*, and /i G 

y{q)- Then the type q down-set module of fi with respect to P is the set 

DSM(/i,g,P) = Span(^{z/ G y{q) | < /iinP}). 

A rule s = (g^, fig, ds) is said to be compatible with P if G DSM(/is, g^, P). 
A rewriting system is compatible with P if all rules in it are compatible with 
P. 

Example 10.18. Suppose Q = {m}, where a;(m) = 1 and a(m) = 2. Con- 
sider the N^-graded set morphisms /i , /2 : ^ — > Baff (N) which have 

/I 0\ /I 1\ 

/i(m) =0100 and /2(m) = 1 
\0 1 2/ \0 1 1/ 

respectively. Both of these have at least one positive element in each row and 
column, so the images of eval/j and eval/2 resides in a sub-PROP of BafF(N) 
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on which, by Corollaries 16 . 51 and 19 . 1 6^ the standard order Q on these matrices 
is a strict PROP partial order which also has the strict uncut property. Hence 
the pullbacks to Nw(f2) of these standard orders are strict PROP quasi-orders 
with the strict uncut property. They are furthermore well-founded, since Q 
is well-founded. 

Considering the rewrite rule s of Example 110. 10[ which has /x^ = rn o 
0(1-'^) ® m and 0^ = 1110111® 0(1"'^), one finds 



eval/,(/i,)= 01000 > 01000 =eval/,(a,) 
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which means s is compatible with both (eval/J*Q and (eval/j)*^. 

Definition 10.19. Let P be a quasi-order on Nw(f2), q G B*^*, and /i G 

y{q)- Also let 5 be a rewriting system for TZ{VL}. Then the type q down-set 
X{S) section of /i G y{q) with respect to P and 5* is the set 



DIS(/i,g,P,S) = 

= Span^l v{jjis — as) I f G V(g, gs), s G 5", and vi^jis) < in P }^ . 

A type q ambiguity (ti,/i,t2) is said to be resolvable relative to P if 
ti(/i)-t2(/i)eDIS(/i,g,P,5). 

Relative resolvability is a technical condition which simplifies various 
parts of the proof of the diamond lemma, but it is not so common that 
it is easier to verify than ordinary resolvability. 

Lemma 10.20. Let P he a well-founded strict PROP quasi-order on Nw(f2) 
which has the strict uncut property. Then for all q,r E M*^* , v G V{q,r), 
and n G y{r), 

p{v){mM{fi,r,P)) C DSM(t;(/i),g,P). (10.8) 

Proof. Any given v must be of the form v{b) = A x 6 for some A G Nw(f2). 
By Theorem 19.171 P is strictly preserved under symmetric join. Hence u < 
/i in P implies v^u) = AxiJ/<Axi/i = v{fj,) in P, so v^u) G DSM(t>(yu), q, P). 
fllO.Sp now follows from the linearity of v and the fact that a down-set module 
is a module. □ 
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The above is sufficient for stating the single-sort generic diamond lemma [SI 
Theorem 5.11] in the present setting. 

Lemma 10.21. Let S be a rewriting system for TZ{Q} and P be a well- 
founded strict PROP quasi-order on Nw(f2) which has the strict uncut prop- 
erty and with which S is compatible. Then for each q G B*^*, the following 
are equivalent: 

(a) Every type q ambiguity of S is resolvable. 

(a') Every type q ambiguity of S is resolvable relative to P. 

(b) Every element of M.{q) is persistently and uniquely reducible, i.e., 
Red{S){q) = M{q). 

(c) M.{q) = lrr(5')(g) ©X(S')(g), i.e., every element of M.{q) has a unique 
normal form. 

Proof. The most noticeable difference between this claim and Theorem 5.11 
of is probably the topological conditions in the latter, but those are triv- 
ially fulfilled in the present setting of discrete topology. A difference of slight 
technical concern is that this claim allows P to be a quasi-order, whereas 
the theorem requires it to be a partial order, but since compatibility is only 
concerned with strict inequalities, one may simply apply that theorem to the 
partial order P o E, where E is the equality relation on Nw(fi). 

The only nontrivial difference is that the theorem requires that t(z/) G 
{u} U DSM(i/,g,P) for all u G N^(fi)(g) and t G Ti(^)(g), i.e., that the 
simple reductions are compatible with the order P, rather than the rules 
as in the present claim. The former is however a direct consequence of 
Lemma 110.201 and the way the simple reductions were constructed: any t G 
Ti{S){q) is of the form t^^s for some s E S and v G V{q,qs). Hence if 
u 7^ v{fis) then t„,s(z/) = z/, whereas ii v = then t^^s{v) = f (Og) G 

p{v)(pSM{fis,qs, P)^ C DSM(i/, g, P); either way the condition is fulffiled. 

□ 

The reason for this switch to a statement in terms of quasi-orders is 
primarily a build-up of experience. In almost any application of the diamond 
lemma one constructs the order as a lexicographic composition of quasi- 
orders, which does usually not end up automatically being a partial order. 
Hence most applications of the diamond lemma of ^ will contain one extra 
step of composing the constructed quasi-order with the equality relation to 
make it a partial order, and that step might as well be inlined into the 
theorem. 
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Lemma 110.211 is however not entirely satisfying, for two reasons. One is 
that it only speaks about one transference type at a time, whereas arguments 
involving PROP elements rarely restrict themselves to just one type. The 
second reason, which is the more important one, is that conditions (a) and 
(a') in the lemma ask for (explicit) resolutions of all ambiguities, rather than 
just the ones of which all others are shadows. Combining the above with 
Theorem 6.9 of [S] does however suffice for producing the following theorem. 

Theorem 10.22 (Diamond Lemma for 7?.-linear PROPs, criticality version). 
Let S be a rewriting system for TZ{Q} and P be a well-founded strict PROP 
quasi- order on Nw(r2) which has the strict uncut property and with which S 
is compatible. Then the following are equivalent: 

(a) All critical ambiguities of S are resolvable. 

(a') All critical ambiguities of S are resolvable relative to P. 

(b) Red(S')(g) = M{q) for all q G B'^', i.e., the rewriting system S is 
terminating and confluent. 

(c) M{q) = Irr(S')(g) ®X{S){q) for all q E B"<V In particular, 

7^{fi}(m,n) = lTT{S){Jrnxn) ®X{S){Jmxn) 

for all m,n Ef^. 

Finishing at this point would however not be satisfactory either, because 
the typical application of that theorem requires the user to enumerate all 
critical ambiguities, and that turns out to be a matter which runs into some 
unexpected technical subtleties. These subtleties are ultimately the reasons 
that Subsection 110.21 also defines the analogous concepts of 'terse' and 'deci- 
sive', but the matter warrants a discussion. 

In [5], a distinction had to be made between 'shadow-minimal' and 'shadow- 
critical', because the generality of the setting there (topological spaces, no 
explicit expression structure, and not even an explicit concept of rewrite rule) 
made possible all sorts of infinite descending sequences. A reasonable expec- 
tation is however that once one's set of "monomials" 3^ has been given an ex- 
phcit discrete structure, then any infinite descending chain |(t„, Mn)}^^^ 
of ambiguities (i.e., each (t„, //„,«„) is a shadow of (t„+i, m„+i)) will 
eventually stabilise (for some N, all (tnyfJ^nyUn) for n ^ N are shadow- 
equivalent) simply because there cannot be infinitely many proper refine- 
ments in the corresponding factorisations of the site this happens for 
example in the case of a free associative algebra, even if [3 Example 6.10] 
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takes a more direct approach. In such cases, shadow-critical becomes equiva- 
lent to shadow-minimal, and the shadow- minimal ambiguities are something 
that one may expect to be able to enumerate explicitly. 

Unfortunately, that line of reasoning does not apply for PROPs (when 
acted upon by the class of reductions considered here) ; it is perfectly possible 
to keep factorising forever, even if it is probably a bit counter-intuitive to 
describe what the elements of the sequence in the following example do as 
"getting smaller" . 

Example 10.23. For all n e N, let cr„ e E„ be the "shift one step right" 
permutation, i.e., o"n(i) = i + lifi<n and an{n) = 1. For n ^ 2, define 
Qn e B"^^"^ by qn = 0(o-„) + 0(l") (note: boolean matrix addition). Also define 
Tn G ^2n+i to be the permutation satisfying 
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and define Vn{b) = (f>{Tn) x b for all b G A1(g„+i). Then the following hold for 
all n ^ 2, exhibiting what could be the /i, q, and v for an infinite descending 
chain of ambiguities: 

• e y{qn). 

• 0(1") = 0(t„) X 0(I"+1) = Vn{<f>{r+')). 

• v^e V{qn,qn+i)- 

However, if 2 ^ n < m then there is no f G V(gm, <ln) such that ^(0(1")) = 
{/((I™")! This may seem surprising, since A = 0(1™""" T*r "X") obviously satisfies 
0(1™-) = A XI 0(1"), but the catch is that 6 i— A x 6 is not in V{qm-i qn), and in 
fact this family of maps turns out to be empty. 

In order to see why, it is convenient to think of the boolean matrices g„ 
as biadjacency matrices of bipartite graphs (say, with vertex sets {0, 1} x [n]) 
and view a map v G V{q, r) as making the graph for q from the graph from 
r. Which are then the operations that such a map can perform? There 
are four: it can permute vertices within a side of the graph (so the graph 
is effectively unlabelled bipartite), it can add new vertices (adding isolated 
vertices requires having suitable elements in the signature Q, but even if 
Q = one can always add a pair of vertices joined by an edge), it can 
add new edges (freely, since there are no restrictions on changing a to a 1 
in the transference type), and it can identify pairs of non-adjacent vertices 
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from opposite partitions (by means of a feedback, combined with suitable 
permutations). In this last operation, identifying vertices Uq and ui actually 
removes these vertices from the graph (since they no longer correspond to 
legs of the underlying network), but instead every neighbour of ui gets an 
edge to every neighbour of uq to reflect the increased connectivity. Hence 
the number of vertices can grow as well as shrink, new vertices can be as 
isolated as one wishes, and edges can be added at will, so why is there no 
way to make Qm out of g„ when m> nl Because the graph corresponding to 
Qn is a cycle of length 2n, and there is no way for these operations to increase 
the length of a cycle, although the identification operation can decrease it. 
Considering in particular the girth (length of shortest cycle) of these graphs, 
one finds that has girth 2m, but any graph that can be made from g„ has 
girth at most 2n < 2m. 

Of course, it may still turn out that a nice set of ambiguities exist, with 
the property that every other ambiguity is a shadow of one in the nice set, 
even if the shadow relation in general is not well-founded. An alternative 
approach to finding that set is then to start with a characterisation of what 
its elements should look like, and hope to establish that the resulting set 
is sufficient. This is the approach that lead to the definition of terse and 
decisive ambiguity, and it leads to the following diamond lemma. 

Theorem 10.24 (Diamond Lemma for 7^-linear PROPs and sharp rewriting 
systems). Let S be a sharp rewriting system for TZ{Q} and P be a well- 
founded strict PROP quasi-order on Nw(f2) which has the strict uncut prop- 
erty and with which S is compatible. Then the following are equivalent: 

(a) All decisive ambiguities of S are resolvable. 

(a') All decisive ambiguities of S are resolvable relative to P. 

(b) Red(5')(g) = M{q) for all q G B*^*, i.e., the rewriting system S is 
terminating and confluent. 

(c) M{q) = lTi{S){q) ®I{S){q) for all q E B"". In particular, 

'R{n}{m,n) = lll{S){Jmxn) ®I{S){Jmxn) 

for all m,n eN. 

Proof. By letting q range over all of B*^* in Lemma riU.2H (b) implies (c), and 
(c) implies that all ambiguities of S are resolvable, which of course includes 
the decisive ones. Hence (c) implies (a). Moreover, ordinary resolvability 
implies relative resolvability by [5l Lemma 5.10], so (a) imphes (a'). 
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The tricky part is, as always, whether relative resolvability of ambiguities 
implies (b). First, it follows from Lemma 6.7] that every montage am- 
biguity is resolvable relative to P, and in combination with (a') this means 
all terse ambiguities of S are resolvable relative to P. By Lemma I10.13[ 
every ambiguity of S" is a shadow of a terse ambiguity of S, and hence by [5l 
Lemma 6.3], all ambiguities of S are resolvable relative to P. Hence (a') of 
Lemma [10.211 holds for every q G M*^', and thus (b) holds too. □ 

After verifying resolvability of the ambiguity in Example 110. 10[ one may 
thus use the above theorem to exhibit the unique normal forms of arbitrary 
associative products. Indeed, this argument works also for associative prod- 
ucts in operads, and that special case is common enough to justify an explicit 
corollary. It is however convenient to first make a few definitions. 

Definition 10.25. An N^-graded set V is said to be operadic if uj{x) = 1 
for all X E V. A rewrite rule s is said to be operadic if u{fis) = 1, and a 
rewriting system is operadic if all rules in it are operadic. An ambiguity is 
operadic if it has type Jixn for some n. 

A direct specialisation to the operadic setting is then the following. 

Corollary 10.26. Let Q be operadic. Let S be an operadic rewriting sys- 
tem for 7l{fl} and P be a well-founded strict PROP quasi-order on Nw(n) 
which has the strict uncut property and with which S is compatible. Then the 
following are equivalent: 

(a) All decisive operadic ambiguities of S are resolvable. 

(a') All decisive operadic ambiguities of S are resolvable relative to P. 
(a") All decisive ambiguities of S are resolvable relative to P. 

(b) Red(5)(Jixn) =n{n}{l,n) for aline N. 
(b') Red(5)(g) = M{q) for all q G B'^V 

(c) n{n}{l,n) = Irr(5)(Jix„) ©X(5)(Jix„) for all n G N. 

(c') M{q) = lTT{S){q)®I{S){q) for all q e I'^V 

Remark. If taking the quotient TZ{^1} / = (mod S) here, one gets not only 
the (freest) operad generated by Q and satisfying the relations expressed by 
the rules of S, but also the PROP that it generates. 
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Proof. An observation that should be made is that if is operadic, then 
every input leg of every G G Nw(f2) is in a unique path from 1 to 0, so 
Trf(G) has a 1 in each column. For an operadic rule s this implies that 
Trf(/is) = Jixa(fj,s)y cind thus the rewriting system 5" is sharp. This means 
the conditions of Theorem 110.241 are fulfilled, and thus (a"), (b'), and (c') 
above are known to be equivalent. Moreover (b') implies (b) and (c') implies 
(c). By letting q in Lemma [10.211 range over Jixn for n G N, one also gets 
that (b) implies (c), and (c) implies that all operadic ambiguities of 5* are 
resolvable, which in particular implies the above (a). Hence everything again 
boils down to the ambiguities. 

As in the proof of Theorem I10.24[ it follows from [5| Lemma 5.10] that 
ordinary resolvability implies relative resolvability, so (a) implies (a'). Fur- 
thermore (a') and (a") are the same, because every decisive ambiguity of 5* 
must be operadic: By definition every edge and inner vertex of the site of a 
terse ambiguity must correspond to an edge and inner vertex respectively of 
at least one of the left hand sides of the two rules. These rules are operadic, 
so their left hand sides are trees and thus connected. By Lemma 110.151 they 
must have at least one edge or inner vertex in common, so the ambiguity site 
is connected. Taking into account that Q is operadic, it thus follows that the 
site has exactly one output leg, and thus the ambiguity is operadic. □ 

It is possible to continue along this line of specialisation, and restrict 
to arity (i.e., consider only 7^{fi}(l,0)) to get a diamond lemma for 71- 
linear fi-algebras, but both that and the operad case may be better served 
by something shown directly using the machinery in [5]. In particular, it 
may be awkward to have to construct the order P for all components of 
the PROP, if one only wishes to use it for elements of coarity 1. The entire 
construction of Nw(f2) is also something that can be simplified if only the 
(l,n) components are of interest. Theorem 110.241 is primarily intended for 
problems that actually exercise the generality of the network concept. One 
example of that would be the rewriting system of (11. ip and (11.21) . but that 
is a matter for another paper. 

Still, this theorem is not quite satisfactory as "i/ie Diamond Lemma for TZ- 
linear PROPs," and the reason for this is the little word 'sharp' that appears 
in it. This is needed because of Lemma flO.lSt but why is it needed there? The 
arguments involving Theorem 18 . 1 71 only make use of the networks themselves, 
so why would the transference type of the underlying rules make a difference? 
Well, Example 110. 23l should have made clear that the transference type can be 
precisely what prevents something from being a shadow. Analysing exactly 
how the method of Lemma 110.131 can fail is however instructive. 
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Example 10.27. Let rj G ^2(1,0), e G ^2(0,1), and consider the rule s = 
{■hxiiV ° ^1 0(1^))- This rule is rather artificial, because its consequences are 
draconic: 

Ko\ = Ko{rjOe)o\=(KOVl)® 0(1°) O 0(1°) (g) (e O A) = 

= 0(1"*") ® e O K® \ o 7] ® 0(1^) = {7]Oe)®eOK®\o7]®{j]Oe) = 

= e®{r]oe)oK®\o{r]oe)®r] = e® 0(1^) o k® \ o 0(1^) ® r] = 
= o K o 0(1"'^)) ® (0(1"*^) o \ o 1]^ = \o(^r]oe)on = \ohi (mod {s}) 

for all A G Nw(f2)(l, 1). On the other hand this rule is at least simple, and 
will thus to some degree avoid cluttering the example with irrelevant details. 

The transference type of s cannot be since = 0(1^) ^ A^(0), but 
Trials) = so it is not sharp, and hence the conclusion of Lemma 110.131 
need not hold for the rewrite system {s}. But how does the proof fail? 
Let K G Nw(n)(l, 1) \ 3^(0) be arbitrary and consider the type ambiguity 
{tvi,s, /W, tv2,s), where /x = rjoeoKorjoe, vi{b) = bonorjoe, and V2{b) = rjoeonoh. 
The site is mapped to k o ?^ o e by the first reduction and to o e o k by the 
second. 

The method Lemma [10.131 would use to simplify this ambiguity is to cut 
out the middle n part, resulting in the network /i' = t] ® r] o e ® e from 
which the previous is recovered as = (0(^X^) ® x /i'. Perhaps somewhat 
unexpectedly, the new ambiguity (ti;^,s, /i', ti,;,,s) has v[{h) = e ® b ®) rj and 
^2(^) — V ^ b ® ^ — the first reduction acts on the first t] and second e of 
fi', whereas the second acts on the second rj and first e — but a moment of 
thought makes it clear that one cannot have one of them act simultaneously 
on the second rj and second e, since that would produce a cycle. Another way 
of arguing this point is that the type of the /i' ambiguity needs to have a 
in position (2, 2) for the annexation /i = (0(^X^) ® /t) x /i' to be allowed, and 
that prevents rule s from simultaneously applying to those two vertices since 
its transference type is too high. But what is the type of the fi' ambiguity? 
This turns out to be the crux of the matter. 

For the rule s to apply in both cases, the type has to be at least ( ? o ) = 
0(^X^). Unfortunately this contradicts the claim that it should have the /j, 
ambiguity as a shadow, because 

/o 1 o\ r(o) (1 0)- 

Trf(0(^Xi)®/€)= 1 = /1\ fO 0\ , 

Vo ij [[o) [o l)_ 

so 
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is the minimal type of a /i ambiguity that is a shadow of the /x' one, whereas 
it was stated above that the fi ambiguity under consideration here has type 0. 
This is possible since Trflrjoe) = and thus Trf(fi:or7oe) = = Trf (77 o e o k) , 
even though 7^ 0. Thus the ambiguity at /z' indeed has an ambiguity at 
/X as shadow — only it was not the one for which a terser form was sought, 
because it has the wrong transference type. 

Another way of looking at this is that when determining the minimal 
type of an ambiguity (t^^^^^, /z, ^^2,52); there are three kinds of dependencies 
that must be considered: vertices in fi, entries that are 1 in g^i, and entries 
that are 1 in Qs^; these may be viewed as three different kinds of edges in an 
abstract dependency graph (the vertices of which are roughly the edges of n), 
and each directed path between two legs of this dependency graph requires a 
position in the type of the ambiguity to be 1. However, not all paths need to 
be considered; for both rules to apply, it is necessary that all paths of fi and 

edges are cared for, and also necessary that all paths of and edges 
are cared for, whereas it is not necessary to consider paths mixing g^^ and 
edges. If, on the other hand, one works out the conditions for (t^^^^^, /x, ^1,3,52) 
to be a shadow of some /i', ^^^^^2) then it is necessary to also consider 

paths made up of all three types of edge; a position that is 1 in the type of 
the /i' ambiguity retains no memory of whether it is there because of a or 

path, so when /i' is annexed by another network to form /x then there can 
arise dependency paths mixing g,,^ and g^j dependencies. This is precisely 
what happens in the example above. It does not happen in sharp rewriting 
systems, because in that case the g^^ and g^j dependencies only duplicate 
what is already in fi and thus common anyway. 

So is this the fault of the symmetric joins? In part, but not in the sense 
that one would be better off with convex subexpressions; the rule considered 
in Example 1 1 . 2 71 would have just as dramatic consequences in a more tradi- 
tional formalism with convex subexpressions, and if there is any difference it 
would be that even more ambiguities are required to capture them all. This 
example is rather a sign that the transference types are too coarse; keeping 
track of enough of the dependencies to cut out the k above requires finer 
control of the internal structures of the networks. Refining the rewriting 
machinery to provide such control is however a problem that will have to be 
addressed in future research. Also, it would be a mistake to expect that these 
problems only turn up in artificial examples such as the above example. 

Example 10.28. Assume /x G 2) and A G ^2(2, 1), and consider the two 
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rules 

51 = (J2X2,0(I') ®/UO A®(/.(|l),Ao/i), 

52 = (J2x2,/i® 0(1^) O0(l^) ® A, Ao/i). 

These encode the primary identities satisfied by the product /x and coproduct 
A of a Frobenius algebra (see e.g. namely that 

0(|i) (g)fioA(g) 0(1^) = Aon = fi(g) 0(|i) o 0(|i) ® A; 

reducing to the middle expression here seems natural, since picking any of 
the others as the thing to reduce to would introduce an unintuitive left-right 
asymmetry. It does however render the rewriting system non-sharp. 

An interesting non-decisive ambiguity is that at /i®/io0(|-^^^X-'^^|-'^)oA® A, 
which in network notation can be depicted as follows: 




Clearly, the two reductions produce different results, but both are irreducible, 
so this is a non-trivial congruence that follows from the rewriting system. On 
the other hand, there is no overlap of the rules in the site of the ambiguity, 
so it is easy to believe that this ambiguity should be a mere montage. That 
it evidently is not (a montage should be resolvable) signals that PROPs may 
exhibit ambiguities that do not belong to either of the traditional classes 
overlap and inclusion ambiguity. A suitable name for this kind of ambiguity 
might be wrap ambiguity, since it is the way that the left hand sides wrap 
over each other that makes it necessary to take this ambiguity into account. 
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